Cheap Storage, Digital Pack Rats… Opening Up New Possibilities

from the everything-must-stay dept

Back when Google first launched Gmail, the big revolution wasn’t necessarily in the interface, but the fact that it was offering 1 Gb of storage for online email, with the announcement noting that you should never have to delete email again. It turns out they were a little hasty in that claim, and even though the company has added a lot more storage, some people still found themselves running out of room and deleting stuff (and now even Google is charging extra for additional storage). However, it certainly is reaching the point where digital storage is so cheap that many companies are finding it easier to just save everything possible. There’s no reason to throw out data any more. This has certainly resulted in some problems, such as when companies leak data — but it’s also leading to new potential tools and services, such as much better computer learning systems, that can simply process tons and tons of stored data to figure things out. So, perhaps the quest for better artificial intelligence will actually be served better not by all the attempts at better algorithms or other tricks — but by the fact that there’s so much data out there that no one’s getting rid of, that we’ll be able to create machines that learn how to be intelligent by going through all of it.

Filed Under: ,

Rate this comment as insightful
Rate this comment as funny
You have rated this comment as insightful
You have rated this comment as funny
Flag this comment as abusive/trolling/spam
You have flagged this comment
The first word has already been claimed
The last word has already been claimed
Insightful Lightbulb icon Funny Laughing icon Abusive/trolling/spam Flag icon Insightful badge Lightbulb icon Funny badge Laughing icon Comments icon

Comments on “Cheap Storage, Digital Pack Rats… Opening Up New Possibilities”

Subscribe: RSS Leave a comment
21 Comments
mr. whatever says:

Re: shut up Mike

Wow…that was a well formulated argument against Mike’s article. How did you ever come up with such compelling reasons for ripping on someone else’s opinion? Hey, dude, perhaps you should consider the possibility that for a great deal of people it’s becoming increasingly easier to simply keep copies of everything as opposed to having to delete them.

It’s not a far fetched idea, though it may be a bit premature. I’ve got ~6TB of home storage an it’s almost completely filled with pictures, photoshoppings, home movies, and DVD backups (MCE is a nice thing when paired with MyMovies, no more sifting through bookcases of DVDs to find what I want).

Read TFA says:

Re: Re: shut up Mike

Also, systems like those that beat Kasparov at chess back in the day were built on depth first searching of possible chess moves…just a huge database of things that it could do. The larger the DB and the faster the searching, the better a system will perform at chess. Unless, of course, someone can actually come up with a real learning algorithm, then sufficient learning will probably perform as well as a big calculator.

Boost says:

Re: Re: shut up Mike

Not to rip on you or anything, but do you have a life outside of your computer? 6 Terabytes? Are you kidding me? I’ve been making due with less than 50 Gigabytes for the last 4 years. Yeah, I don’t really download at all, but damn dude what the hell are you trying to do, back up the internet?

One Love (user link) says:

Need better desktop Search

I am on a Windows XP box, and the search function to go through my rat pack hard drives filled with absolutely blows. Desktop search on the my girlfriend Mac OS X sucks as well.

I know Google has the desktop thingy, but I am loathe to open the deeper recesses of my digital attic to the AI that has become Google, ever though I am a fan.

Personal spiders and bots ? Something a bit more accurate than Clippy ?

🙁

Shohat says:

Hello Mike

You post made no sense. Not only did it not make sense , it was misleading.
So, perhaps the quest for better artificial intelligence will actually be served better not by all the attempts at better algorithms or other tricks — but by the fact that there’s so much data out there that no one’s getting rid of,
Is an insult to intelligence(no pun intended).
While one of AI’s most important forms is actually data compression(you know, algorithms+tricks !) , you have no idea how off the target you are.
You know that a baby is born an intelligent being right? It is able to learn languages from scratch, and without any “translation” but he’s own logic.
Intelligence != knowledge.
Clearly, the thing you think AI is , is just not AI.

Mike (profile) says:

Re: Hello Mike

While one of AI’s most important forms is actually data compression(you know, algorithms+tricks !) , you have no idea how off the target you are.

Well, it’s great to know that there are folks around who are always willing to try to set me straight. Though, I’m not sure I understand your complaint here.

You know that a baby is born an intelligent being right? It is able to learn languages from scratch, and without any “translation” but he’s own logic.
Intelligence != knowledge.

I wasn’t saying that AI was in the data alone. But, as the article stated, the fact that more data is available makes it that much easier to train new AI systems and to test out larger scale machine learning systems.

Cooperate Storage. says:

Information Age.

Hello people, we are not talking about our own home/personal storage, I have a ton myself, but it’s nothing compared to cooperate databases and important documents that they create in everyday business. Also studies and lab work from research companies, video data from whatever application used some. Also our world information doubles almost every 14 months from the previous year, just think about about how much info there is out there. Yes it is true that we do need intelligence to learn from knowledge, but AI in theory if developed properly is capable of learning in it’s own way.

silver says:

Do you work for the man?

It sounds like Mike works for the government trying to datamine everything on everone. While it might be easier to keep everything, lets pretend it’s like the old shoeboxes of transactions people used to have, and not some monster database where someone can find out everything from what movies I watch to what toothpaste I like, to what condoms I use! The last thing I need is a jelous governmental emplyee looking through my data!

Mike (profile) says:

Re: Do you work for the man?

It sounds like Mike works for the government trying to datamine everything on everone.

I’ve heard all sorts of false conspiracies about who I “work” for, but this is a first. This has to be the funniest blind accusation I’ve read in quite some time.

While it might be easier to keep everything, lets pretend it’s like the old shoeboxes of transactions people used to have, and not some monster database where someone can find out everything from what movies I watch to what toothpaste I like, to what condoms I use! The last thing I need is a jelous governmental emplyee looking through my data!

You seem to have jumped to quite the paranoid conclusion. All I pointed out was that it was easier to keep data, so many companies are keeping data — and that’s allowing them to do all sorts of interesting datamining activities. That has nothing to do with the gov’t or whether or not someone’s spying on you.

Add Your Comment

Your email address will not be published. Required fields are marked *

Have a Techdirt Account? Sign in now. Want one? Register here

Comment Options:

Make this the or (get credits or sign in to see balance) what's this?

What's this?

Techdirt community members with Techdirt Credits can spotlight a comment as either the "First Word" or "Last Word" on a particular comment thread. Credits can be purchased at the Techdirt Insider Shop »

Follow Techdirt

Techdirt Daily Newsletter

Ctrl-Alt-Speech

A weekly news podcast from
Mike Masnick & Ben Whitelaw

Subscribe now to Ctrl-Alt-Speech »
Techdirt Deals
Techdirt Insider Discord
The latest chatter on the Techdirt Insider Discord channel...
Loading...