I want to duplicate the functionality of youtube

The war between wetware and hardware.
User avatar
gnome
Posts: 21763
Joined: Tue Jun 29, 2004 12:40 am
Location: New Port Richey, FL
Has thanked: 336 times
Been thanked: 341 times

Re: I want to duplicate the functionality of youtube

Post by gnome » Mon Mar 26, 2018 12:24 am

I'd be curious what kind of content turns up. Not in a snarky way either.
"If fighting is sure to result in victory, then you must fight! Sun Tzu said that, and I'd say he knows a little bit more about fighting than you do, pal, because he invented it, and then he perfected it so that no living man could best him in the ring of honor. Then, he used his fight money to buy two of every animal on earth, and then he herded them onto a boat, and then he beat the crap out of every single one. And from that day forward any time a bunch of animals are together in one place it's called a zoo! (Beat) Unless it's a farm!"
--Soldier, TF2

User avatar
Anaxagoras
Posts: 20769
Joined: Wed Mar 19, 2008 5:45 am
Location: Yokohama/Tokyo, Japan
Has thanked: 1310 times
Been thanked: 1092 times

Re: I want to duplicate the functionality of youtube

Post by Anaxagoras » Mon Mar 26, 2018 6:12 am

How does youtube prevent things like pornography (especially the illegal sort) from showing up?

Hosting is not so simple as "here's a platform, now anyone can just use it." You still need to keep an eye on the content to make sure it's only being used for stuff you approve of or that it was intended for. And that nothing illegal is slipping through the cracks. If it's only a dozen videos per day that would be easy, but youtube has 300 hours of video uploaded every minute. I really don't know how they check that stuff. I guess they rely on users to report the illegal videos to remove them.
A fool thinks himself to be wise, but a wise man knows himself to be a fool.
William Shakespeare

User avatar
Abdul Alhazred
Posts: 69401
Joined: Mon Jun 07, 2004 1:33 pm
Title: Yes, that one.
Location: Chicago
Has thanked: 2773 times
Been thanked: 1064 times

Re: I want to duplicate the functionality of youtube

Post by Abdul Alhazred » Mon Mar 26, 2018 9:10 am

In general, they have to rely on specific complaints.

Even without their recent expansion the definition of "unacceptable" it has lead to abuse, but it worked rather well in keeping them in the clear legally.
Image "If I turn in a sicko, will I get a reward?"

"Yes! A BIG REWARD!" ====> Click here to turn in a sicko
Any man writes a mission statement spends a night in the box.
-- our mission statement plappendale

User avatar
Grammatron
Posts: 32849
Joined: Tue Jun 08, 2004 1:21 am
Location: Los Angeles, CA
Been thanked: 1571 times

Re: I want to duplicate the functionality of youtube

Post by Grammatron » Mon Mar 26, 2018 6:01 pm

Anaxagoras wrote:How does youtube prevent things like pornography (especially the illegal sort) from showing up?

Hosting is not so simple as "here's a platform, now anyone can just use it." You still need to keep an eye on the content to make sure it's only being used for stuff you approve of or that it was intended for. And that nothing illegal is slipping through the cracks. If it's only a dozen videos per day that would be easy, but youtube has 300 hours of video uploaded every minute. I really don't know how they check that stuff. I guess they rely on users to report the illegal videos to remove them.
Combination of automated algorithms and user reporting. That being said "prevent" may not be the right word here, I would suggest "minimize".

There isn't much difference between content posted here and a video hosting platform when put into context of legality of content.
[quote="pillory"]jokes aren't funny....seriously thinking......

seriously thinking might be funny....but it's not joke[/quote]

User avatar
Anaxagoras
Posts: 20769
Joined: Wed Mar 19, 2008 5:45 am
Location: Yokohama/Tokyo, Japan
Has thanked: 1310 times
Been thanked: 1092 times

Re: I want to duplicate the functionality of youtube

Post by Anaxagoras » Tue Apr 24, 2018 1:16 am

I do wonder how an algorithm detects "adult content" or "spam." And also how many false positives there are, i.e., a video that doesn't contain any objectionable content, but triggers the algorithm anyway? Are they looking for lots of bare skin? Can the algorithm recognize nudity or human sex organs? I thought it was hard for a computer to recognize and identify objects like we can.

YouTube says computers helped it pull down millions of objectionable videos in three months
Software helped YouTube flag 4.5 million videos before anyone ever saw them. But another 1.5 million got through, at least briefly.

Bad news for YouTube: Last quarter, users uploaded millions of objectionable videos to the world’s largest video site.

Good news for YouTube: Last quarter, the site pulled down millions of objectionable videos before any users saw them.

The news YouTube wants you (and investors, and advertisers) to focus on: It is successfully training computers to flag objectionable videos, because that’s the only way it will be able to sort out the bad stuff from the site’s enormous crush of clips.

All of that comes from a brief aside in Google CEO Sundar Pichai’s scripted remarks during parent company Alphabet’s earnings call today. He said YouTube had pulled down more than six million videos in the last quarter of 2017, after first being flagged by its “machine systems,” and that 75 percent of those videos “were removed before receiving a single view.”

(Update: YouTube has published a blog post with more complete numbers. It says it pulled down more than 8 million videos in the quarter — “mostly spam or people attempting to upload adult content,” and that 6.7 million were flagged by computers first. It also says it is getting better at finding videos with “violent extremism”: At the beginning of 2017, 8 percent of the videos with that content were taken down before they got to 10 views. “Now more than half of the videos we remove for violent extremism have fewer than 10 views.”)

Context: YouTube has spent the past year responding to complaints about problematic (or worse) videos on the site. Sometimes it has argued that offensive videos — or, at least, offensive videos running alongside advertising — are a “tiny, tiny” problem; at other times, it says it is taking it so seriously that it will have more than 10,000 people working on the problem this year.

But like Facebook, Google and YouTube execs believe that the company’s scale means that it will ultimately need to rely on computers and artificial intelligence to solve its content problem. Hence Pichai’s earnings call commentary, which is (obviously) meant to be encouraging.
A fool thinks himself to be wise, but a wise man knows himself to be a fool.
William Shakespeare

User avatar
Mentat
Posts: 10271
Joined: Tue Nov 13, 2007 11:00 pm
Location: Hangar 18
Has thanked: 37 times
Been thanked: 124 times

Re: I want to duplicate the functionality of youtube

Post by Mentat » Tue Apr 24, 2018 2:44 am

IIRC they break their videos down into quantitative thumbprints that captures key features in the video. Then they use some supervised machine learning algorithm to associate those features with a categorical flag label by examples their employees and some users manually create. Or at least that's how they used to do it.
It's "pea-can", man.

Lapis Sells . . . But Who's Buying?

User avatar
Witness
Posts: 14885
Joined: Thu Sep 19, 2013 5:50 pm
Has thanked: 1750 times
Been thanked: 2347 times

Re: I want to duplicate the functionality of youtube

Post by Witness » Tue Apr 24, 2018 3:37 am

And ed, still on it? :mrgreen:

User avatar
Anaxagoras
Posts: 20769
Joined: Wed Mar 19, 2008 5:45 am
Location: Yokohama/Tokyo, Japan
Has thanked: 1310 times
Been thanked: 1092 times

Re: I want to duplicate the functionality of youtube

Post by Anaxagoras » Tue Apr 24, 2018 6:08 am

Witness wrote:And ed, still on it? :mrgreen:
That's kind of what I'm getting at.

Even if you could duplicate their functionality so that anyone with an Internet connection could upload videos to it, you still need to keep track somehow of what's actually in those videos so that, for example, you don't end up hosting child porn or other content you don't want on your site. So it isn't so easy.
A fool thinks himself to be wise, but a wise man knows himself to be a fool.
William Shakespeare

User avatar
Abdul Alhazred
Posts: 69401
Joined: Mon Jun 07, 2004 1:33 pm
Title: Yes, that one.
Location: Chicago
Has thanked: 2773 times
Been thanked: 1064 times

Re: I want to duplicate the functionality of youtube

Post by Abdul Alhazred » Tue Apr 24, 2018 12:02 pm

About detecting "adult" videos.

In nearly all cases it is in the interest of the content provider to have it detected, and it will be tagged as such, including specialty.

For example, ADULT, GOAT, STRAIGHT

Or is there a moral panic on about tricking children into watching it?
Image "If I turn in a sicko, will I get a reward?"

"Yes! A BIG REWARD!" ====> Click here to turn in a sicko
Any man writes a mission statement spends a night in the box.
-- our mission statement plappendale

User avatar
Abdul Alhazred
Posts: 69401
Joined: Mon Jun 07, 2004 1:33 pm
Title: Yes, that one.
Location: Chicago
Has thanked: 2773 times
Been thanked: 1064 times

Re: I want to duplicate the functionality of youtube

Post by Abdul Alhazred » Tue Apr 24, 2018 12:04 pm

Ed can handle illegal content the way SC does. By responding to complaints.

I'm assuming his site will not be so high traffic as to make this impractical.
Image "If I turn in a sicko, will I get a reward?"

"Yes! A BIG REWARD!" ====> Click here to turn in a sicko
Any man writes a mission statement spends a night in the box.
-- our mission statement plappendale

User avatar
Witness
Posts: 14885
Joined: Thu Sep 19, 2013 5:50 pm
Has thanked: 1750 times
Been thanked: 2347 times

Re: I want to duplicate the functionality of youtube

Post by Witness » Wed Apr 25, 2018 1:56 am

Abdul Alhazred wrote:Ed can
a lot of things, but does he still want to (go to all that trouble)?

Reminder (oldish article, new ways have certainly been found): https://www.opswat.com/blog/can-video-f ... tain-virus

:(