Digital documents NFT is the only solution for the upcoming massive chaos of AI generated digital material.
What a techbro take.
That’s only a solution if everyone adopts it. Which I doubt will happen on social media.
Because you cannot make NFT of AI generated picture?
That’s not the point. You can’t stop digital files for being generated or even put nft. But the origin of them would be needed (sadly, forced) be validated against a trusted source.
And who is going to be this trusted source? 🤷
Blockchain is basically a one-way database, someone still needs to put data in it.I don’t know. Do I look like a fortune teller? It’s just a thought and no one knows what is going to happen.
what’s wrong with simple cryptographic signatures?
why do I need a block chain?
That could be also. But how do you confirm the legitimation of the file? I’m asking because I’m not sure if there is an easy way, like a HASH checking and something that can support it for validation.
do you trust the person who signed it? if not, dont fucking trust it.
what more needs to be done?
From a logistical perspective, an arbitrary and every increasing number of documents tied to a single blockchain sounds like it’ll create a chain that is unfathomably hard to work with. It’ll eat up all the hard drive space you’ll have available.
AI is creating fake XY, and that is problems, problems, problems everywhere…
During the last decades, IT guys and scientists have always dreamed about using AI for good things. But now AI has become so much better at creating fake things than good things :-(
It’s not really a new problem, people were doing it with their imaginations and stories long before AI came around. The tools of the digital age simply amplified the effect. Healthy skepticism is still the solution, that hasn’t changed.
It’ll never actually go away, though. Of all the possibile ways of looking at any given situation, the vast majority will always be inaccurate. Fiction simply outnumbers nonfiction. Wrong answers outnumber correct answers.
So, the adjustment has to be inside of us, and again, it’s always been necessary. This isn’t fundamentally new.
The new thing is the scope in which fake content is being created. In a very near future most internet content will be fake, including history. That is not something that has happened before in history.
The current AI situation is completely unprecedented in history.
I would disagree. I think if we go back even a few centuries, we find that virtually nobody had a firm grasp on historical fact, due to the printing press not being invented yet, alongside archeological techniques not existing.
As someone with an academic background in history, historical record keeping both written and oral existed long before the printing press.
Certainly, but before widespread literacy, did a large portion of the populace have interest in and access to them? Particularly an accurate understanding of how their own culture fit into the broader scope of human history?
That depends on the culture and the method of distribution, many cultures that practice oral history did have widespread interest and access to it and an understanding of how their culture fit into the broader scope of the world to some degree, though the way they understood or related to it might differ from culture to culture (some cultures tie their history to places, or names, or events, or people or seasons, etc). As another example, the Romans are well known for their prolific historiography and many of their surviving texts are still referenced to this day. Look up Pliny the Elder and Pliny the Younger, who were just as well known and respected as historians at the time as they are now. While written works such as the Encyclopedia Natural History (written by Pliny the Elder and believed to be the first encyclopedia) would often be released to the public to be copied and spread, they would also often recite written works orally so illiteracy wasn’t as much of a barrier as you’d think. Oral history is a lot more important in providing a record of a culture’s history as well as making that history accessible to others than a lot of people think. It was important in ancient Greece as well, and is a huge part of many other cultures around the world including many indigenous ones. It’s also not as inaccurate or unreliable as some people might think, as there were many methods these cultures used and still use to preserve the accuracy of their oral history as it was passed down from generation to generation.
Now in terms of awareness, obviously there was propaganda and rewritten history going on back then just as there is now, but it’s not as if none of the citizens would have been aware of that. One of the papers I wrote for a class about the importance of comparing primary sources featured 3 different accounts of what Athens was like and the views people there held at a certain point in history from 3 different people of varying social and financial status, and there was absolutely awareness of that sort of dissonance between what their government claimed and what the reality was even among the more common folk. So I would say they did certainly have a significant understanding of how their culture fit into the broader scope of human history.
Which is why they claimed their city was founded by a couple brothers of divine origin, right? And calling Plinys Naturalis Historia respected by modern historiography is laughable, I’m sorry. Naturally it wasn’t his fault, he was mainly compiling other primary sources of his time, but it is in no way something that should be simply taken at face value.
Regardless, my broader point was never to try to say that history began with the printing press or something. Clearly, if it were not for older records in everything from the knotwork language of ancient Peru to newly readable scrolls recovered from the Vesuvius eruption, we wouldn’t have any clue what happened previous to the 15th century, now would we? Which, clearly we do.
Instead, I was making a point about the nature of information accuracy, and the importance of skepticism in approaching information. In the same way I wouldn’t want to read Pliny and assume it’s contents were 100% accurate, I also wouldn’t want to just believe everything I see online. It’s not new to have reason to doubt our information space, and thus the effects of AI misinformation are overblown imo. Appropriate skepticism and critical thinking skills are still a viable solution.
Lastly, please explain how this:
So I would say they did certainly have a significant understanding of how their culture fit into the broader scope of human history.
follows from this:
One of the papers I wrote for a class about the importance of comparing primary sources featured 3 different accounts of what Athens was like and the views people there held at a certain point in history from 3 different people of varying social and financial status, and there was absolutely awareness of that sort of dissonance between what their government claimed and what the reality was even among the more common folk.
I fail to see how three people disagreeing about Athenian history means they understood how Athenian history fit into global history.
People created fake photoshop images long before AI…
Yes but it took a lot of work and the person doing it had spent a long time training. AI has made it very fast and very accessible.
It kind of takes the wind out of the sails, though. Everyone freaked out when Photoshop became a thing because it made doctoring images easier than doing it by hand. If Photoshop didn’t break the world, I have a hard time believing that “easier Photoshop” will either.
You also needed an original to make the fake with Photoshop, with AI you don’t need that so there are no receipts, so to speak, to pull to prove that it’s fake.
It was ever thus:
A lie gets halfway around the world before the truth has a chance to get its pants on.
Winston Churchill
lol it’s “boots,” but I like pants better. Makes the truth seem so much cooler ‘cause it was fuuuuuuuuuckin
See, even quotes with errors in them get upvoted before someone can come along and correct them :)
Ah, so one of those clever case-in-point lemmy comments. Very clever. Your plan was masterful
Nah, even my retcon explanation is a lie. I copied the quote from some famous quote website and didn’t catch the error.
Especially if you are using the word “pants” the way that Churchill would have.
I don’t dare to ask why your truth has been naked before…
Because the truth fucks, homie.
“The truth may be out there, but lies are inside your head.” – Terry Pratchett
When I read the title I sarcastically thought “Oh no, why is AI deciding to create fake historical photos? Is this the first stage of the robot apocalypse?” I find the title mildly annoying because it putting the blame on the tool and ignoring that people are using it to do bad things. I find a lot of discussions about AI do this. It is like people want to avoid that it is how people are using and training the tool is the issue.
Isn’t the tool part of the issue? If you sell bomb-making parts to someone who then blows up a preschool with them, aren’t you in some way culpable for giving them the tool to do it? Even if you only intended it to be used in limestone quarries?
Maybe if the tool’s singular purpose was for killing. I think guns might be a better metaphor there. Explosives have legitimate uses and if you took the proper precautions to vet your customers then it’d be hard to blame you if someone convincingly forged credentials, for example.
That really depends on whether the bomb making part is specific to bombs, and if their purchase of that item could be considered legitimately suspicious. Many over the counter products have the potential to be turned into bombs with enough time or effort.
If a murderer uses a hammer, do you think the hardware store they purchased the hammer from should be liable?
You can make crude chemical weapons by mixing bleach with other household items. Should the supermarket be liable for people who use their products in ways they never intended?
Exactly this, many times over.
Most tools with legitimate uses also have unethical uses.
I would say the supplier is culpable if the tool supplied is made for the purpose of the harm intended or if the supplier is giving the tool to the person who does the harm with the explicit intent for that person to use it for that harm. For example, giving someone an AK-47 to shoot someone or a handgun/rifle with the intent that the user shoot someone with it. If the supplier gives someone a tool to use for one legit purpose but the user uses it for a harmful purpose instead, I don’t think you can blame the supplier for that. For example, giving someone a knife to cut food with, and then the user goes and stabs someone with it instead. That’s entirely on the user and nobody else.
So the potential to do harm should never be considered?
To clarify, instead of intent a better word may be knowledge. If the supplier knows that the user is going to use the tool for harm but gives the tool to the user anyway, then the supplier shares culpability. If the supplier does not (reasonably) know, either through invincible ignorance (the supplier could not reasonably know) or the user’s deception (lying to the supplier), then the supplier is not culpable.
Everything needed to make a bomb can be found at your local Walmart. Nobody blames the gas companies when something gets molotoved.
At this point that’s the equivalent of complaining about people calling gun violence a problem because “guns don’t kill people, people kill people”. If you hand the public easy access to a dangerous tool then of course they’re going to use it to do dangerous things. It’s important to recognize the inherent danger of said tool.
AI is more like torrents, password cracking software, TOR, ect than guns. Just because they can be used for bad or illegal things doesn’t mean those software programs are bad. When companies in the past tried to get certain software banned they ran into the issue that if it could be used for legal reasons that enough for them to exist legally.
Now AI does have the issues with how it is trained so the AI itself can be problematic.
I didn’t say we shouldn’t talk about the problem with the AI I have issues with people making the AI the complete issue ignoring that people use the AI. It reminds me of how automakers tried to make the people driving cars the reason for deaths in car crashes.Thankfully that didn’t work and automakers where forced to make cars safer making it safer on the road. It didn’t stop car crashes from happening since the human element is there. Which there are things in place that partly address that (Such as Driver’s license test, taking away some people’s driver’s license, ads reminding people of the rules of the road.). I’m annoyed that articles are doing the opposite of what car makers did. Humans are using the AI to do bad stuff mentioned that also! How can we change that? Yeah, it will probably be best to do something to the AI program, but we can’t ignore the human element since they the one who are creating the AI, using the AI, and consuming the AI products.
People use guns to kill people so we need to look at both to make it happen less.
@aihorde@lemmy.dbzer0.com draw for me a fake historical photo.
the cat is out of the bag. every nation and company is racing to invent the most advanced AI ever. and were entering times when negative impact of AI outweighs the positive use of it.
I am really feeling uneasy about the uncertain times ahead of us.
I used to be excited about it, especially the image generation AI.
I believe that the internet has already lost a lot of authenticity in general. The amount of misinformation boomers and gen X lap up on their socials is unreal.
Having advanced image/video AI that would force people to call everything into question, to double check and to fact check sounded good. Except, people aren’t fact checking.
The past we know is a carefully crafted and curated story and not at all accurate as it is. It is valuable to learn and understand but also be skeptical. I don’t really think wide spread forgery changes that. Historiography is a very important field.
Any serious historical research will have to verify the physical copies exist or existed in a documented way to be admitted as evidence. This is called chain of custody and is already required.
That’s for historians and professional researchers. It may not sway the field at large, but it’s still a huge risk to public opinion. I shudder to think of the propaganda implications for rewriting history in a near indistinguishable way.
Public opinion can be swayed with a TV advertisement by a game show host and real estate developer. We are all so insanely propagandized now it can’t be more so.
Agreed. “AI” will add some interesting augmentations but when it comes down to it they can just tell a bald-faced lie and most people will believe it because it’s on the news.
Sure, but a TV ad takes (at the least) and editor, or (at the most) a cast and crew. They take by money and time to create, and loop average working people into the process. Of course there will be people in any profession that will make whatever they’re paid to, but by and large, most of the acting/editing industry has some form of ethics.
People debunking false claims takes time too, but since creating them take time as well, things have a chance to balance out (obviously that’s happening less, but there’s still a chance for it to happen). But if an AI model can pump out fake history autonomously, almost instantly, and without any chance for a human with ethics to intervene in the process, debunking/fighting misinformation becomes WAY harder. Because you’re not fighting a person with limited time and resources anymore, you’re fighting a firehose of false content that will bury you without even breaking a sweat.
I should have wrote tweet with spelling errors instead of TV ad.
Interesting article, and a worrying trend. Stamping a bit of text like ‘Generated by Midjourney’ is ridiculously weak protection though. I wonder if some kind of hidden visual data could be embedded within AI images - like a QR code that can be read by computers but is invisible to humans.
Just found the wikipedia page for steganography. Have any AI companies tried using this technique I wonder? 🤔
Specific programs can. You can probably train specific models and alter datasets to include them as well.
But we’re past the point where photo and video is sufficient on its own. Especially when there’s a possibility of state level actors benefiting.
I wonder if some kind of hidden visual data could be embedded within AI images - like a QR code that can be read by computers but is invisible to humans.
Said protection would also be hilariously weak. It would be easy for malicious actors to strip/alter the metadata of the image. And embedding the flag in the image itself is something that can be circumvented by using a model that doesn’t apply any flag.
We’re about to live in a world where nobody can tell truth from fiction.
We’re about to live in a world where nobody can tell truth from fiction.
I would argue that our long history of devising myths indicates we have always lived so.
That’s a fair assessment, but I think it’s going to get a whole lot worse.
Before, to the degree that nobody could figure out the truth, it was largely due to lack of information/evidence. The future will instead have evidence manufactured for whatever opinion you like.
There is the Content Authentication Initiative which keeps track of the source of an image (it was taken by this camera, etc). It’s technically impossible to fake as it’s validated, registered and traceable, but who knows. It’s more a database of known images.
Yeah, the only real way to do it is have people digitally sign their images, but it still comes down to a trust element. You need to trust the person who created/signed the original content. It also means getting content from 3rd parties is going to be a lot harder in the scientific/historical communities of the world.
Have any AI companies tried using this technique I wonder?
Yes, I have read that they want to do something like that. Stamp all images that their AI has created.
But of course it won’t be hard to remove the stamp, if you want to.
The problem is that even if Midjourney did that, there will be other creators have no such moral or ethical issues with people using their software to make these fake photos without any sort of hidden or obvious data to show that they are fakes. And then there will be the ones which have money from a state behind them, and possibly a very large library of surveillance photos for the AI to learn from.
Can AI write car service manuals that are only slightly incorrect?
We’ll now need AIs to spot AI fakes. AI wins!
The problem is that it’s a constant war between fake generators and fake detection algorithms. Sort of a digital version of bacteria out-evolving antibiotics.
Check out Adobe’s Content Authentication Initiative. It won’t prevent those images but it will allow you to verify their source, which in this case should not authenticate.
How about a block-chain verification plan?
Do you think Facebook or Twitter would go for that? I doubt it. Especially Twitter.
And generation is going to win eventually.
And for a reasonable price, the AI corporations will sell you the chance to survive in the world they created for you.
All we really need is some black hat ai developers or power users to make enough compromising and hard to detect deep fakes of Congress people in the US and all of this Gen AI will be banned so fast. I’m surprised it hasn’t happened yet.
It doesn’t really matter if they ban it or not, it is way too late for that any way. It will be out there and used by people who want to use it. It is like nuclear technology, once it is out of the bag it cannot be put back in. Only this is way easier to use than nuclear technology, a single gradeschooler can use it.
Sir, this is the internet.
You can find Ai porn of a great many members of congress.
It just isn’t popular to post on major websites like certain celebrities have been recently.
And trust me, these generated images are getting scarily good.
I have to agree, I would not be able to spot a single one of them as fake. They look really convincingly authentic IMO.
Stalin famously ordered people he had killed erased from photos.
Imagine what current and future autocratic regimes will be able to achieve when they want to rewrite their histories.
Stalin famously ordered people he had killed erased from photos.
This checks out, here’s an article about it: https://www.history.com/news/josef-stalin-great-purge-photo-retouching
So why are you downvoted? Maybe because your view is too optimistic? And the problem isn’t only with autocratic regimes. But much more general.
How do we validate anything, when everything can be easily faked?With AI video also getting increasingly impressive and believable, I worry that we will soon live in a world where you could have actual video evidence of a murder, and that evidence being dismissed or cast into doubt because of how easy, or supposedly how easy it would be to fake.
Absolutely, only video from trusted sources can be used. But isn’t that already the case?
Better than having people get convicted based on fake evidence, though.
I think they are both equally scary. I’m imagining cases where photo and video evidence have played major roles in proving police abuses of power for example. We will certainly have an onslaught of people making faking evidence of all sorts of things to push a political narrative, but equally in any politicized narrative, any politically inconvenient photos or videos of real things that really happened might be swept under the rug as “someone probably just faked that for political gain.” Sure you could have an investigation to look into the authenticity of the evidence, or look at other forensic evidence, but probably only if you can afford to have such an investigation done, or enough public attention gets drawn to it. I fear we are reaching a scary time where, in a sense, reality will be whatever people want it to be, and we will increasingly be unable to trust anything we see as real with absolute certainty. We have been headed down this road for a very long time, but this will just make it much worse
“Photoshopping” something bad existed for a long time at this point.AI generated images doesn’t really change anything other then the entire photo being fake instead of just a small section.
I’d disagree. It takes, now, zero know-how to convincingly create a false image. And it takes zero work. So where one photo would take one person a decent amount of time to convincingly pull off, now one person can create 100 images or more in that time, each one a potential time bomb that will go off when it starts getting passed around as evidence of something. And there are uncountable numbers of bad actors on the internet trying to cause a ruckus. This just increased their chances of succeeding at least 100-fold, and opened the access to many, many others who might just do it accidentally, for a joke, or who always wanted to create waves but didn’t have the photoshop skills necessary.
It changes a lot. Good Photoshopping skills would not create the images as shown in the article.
Yeah some of these would be like 100 layer creations if someone was doing it themselves in photoshop – It would take a professional or near-professional level of skills.
The easy and speed with which AI created photos, of a quality most photoshoppers could only dream, can be created of does very much change everything.
Probably just because some people really like Stalin, and have become convinced his accounts are the truthful ones and everyone else lies about him.
That’s a scary thought!! But all kinds of crazy exist, and I mean people have to be literally crazy to want to live under a regime like Stalin made.
So why are you downvoted?
lemmygrad dot ml
Wikipedia page on the dude: Nikolai Yezhov
Honestly, it looks like the picture on the left is fake, like the guy was inserted into it. Just look at his outline, compared with the rest of the background.
(I’m no Stalin fan, just commenting on the picture itself.)
Digital image editing has been really good for this kind of stuff for quite a while. Now it’s even easier with content aware fill.
Unless you’re the PR manager for the British Royal family. Then you somehow lack the basic skills to make convincing edits.
I can Imagine such regimes novadays to develop some sort of cryptographic photo attestation, so any photo not signed by them is going to be shown as untrusted, regardless if it’s fake or not. And all the code from processor to camera app would need to be approved by their servers in order to get a sign.
Oh wait! Our great friends at Adobe, Intel, Google and Microsoft are already working on just that: https://c2pa.org/
It won’t help for uncles on Facebook spreading lies.
It would not help with anything.
Like 1984.
“statement headline” + “and here’s how you should think” = fuck right the unholy toe fungal hell off.
It’s an opinion piece, they start out with their claim and try to back it up, it’s not a news article, what is the problem?
Their opinion sucks.
Well, that’s exactly what the voting buttons are for.
Same energy as saying “slammed” or “blasted”.
Sure it’s on opinion piece, but it’s indicative of very low quality.
Does that AI think that Indian people are monkeys or something case there is a photo there where it clearly made their face look more inline with a monkey
So AI really is a seminal paradigm-changing technology. For the worse.
For the worse.
Not necessarily.
But we’re going to have to deal with the basic issue of deceiving someone with AI, and if any AI generated thing should be labeled or not as such.
Basically, a legislative fix, and not just a free market free for all.
How do you enforce labelling when there will never be a way to reliably test if something was ai generated?
Basic is not a word that fits the situation.
How do you enforce labelling when there will never be a way to reliably test if something was ai generated?
If the icon is not there and then it’s determined that it’s AI generated, as it was with that British royal family picture the other day; crowd sourced.
I am not understanding you. Or perhaps you’re not understanding me.
Firstly, the British royal family photo was not ai generated.
If you can’t find a way to test if something is ai generated, who decides what is or isn’t ai generated?
Automatic spam generator.
Counterpoint, nuh uh.
There are lessons to learn from the past. I’ll give you that. Those who don’t learn from the past are doomed to repeat it. I’ll give you that.
80% of humanity is too stupid to learn from the past.
Letting them live in fantasy worlds of Make Believe causes no deleterious effects to you or to the Future.
These people who consume this material will choose to voluntarily remain stupid if given the opportunity to make that decision.
After all, to those to whom the truth would be misery, ignorance is bliss and it is folly to be wise.
No deleterious effect? Am I the only one from the COVID-19 timeline?
The problem is that “they” live in the same world as you. Which means that you’d be going right down with them, along with all your loved ones. Is that really what you want?
