Hacker Newsnew | past | comments | ask | show | jobs | submit | swid's commentslogin

My problem with your solution to require author permission to train is that it doesn’t solve anything long term.

What happens when all the licensed information still leads to the creation of demand hoarding AI? Most of what they are stealing is the sum total of human knowledge, which was created before most of us were even born - it is public domain already.


> Most of what they are stealing is the sum total of human knowledge, which was created before most of us were even born - it is public domain already.

Well then they cannot possibly stealing this, and short of creating laws that directly discriminate between algorithmic processing and human consumption - regulating the process, not the subject - this argument is quite literally nonsense.


> There is no near term commercial value

How much do you think other AI companies would offer to get access to the transcripts of the generation that led to the proof? No doubt OpenAI will include it in their training data somehow and use it to build the next generation.

There is already economic value.


If our own brains were insufficient to demonstrate the fallacy of the Chinese Room; the particles, molecules, cells, synapses, and so forth of our bodies cannot be believed to have understanding, but we recognize it in the sum of the part anyway....

... we now have LLMs to even more pointedly show the deficiencies of the argument.


It’s funny you defend your independence by giving explanations of how you changed your peanut butter buying habits. The point was we don’t care what kind of peanut butter you buy; it’s not a meaningful kind of choice to have.


First, whether something is meaningful or not, depends on the subject.

Independence here isn't about whether your mind exists in a parallel world - devoid of external inputs - it's whether your input is required for an action to happen or not. They didn't simply comply with a choice from above, they experimented and came with an option that works for them. It doesn't matter whether that's a common choice or not, but who held the final authority in it.

In centralized systems, your input is, in theory, basically irrelevant/in practice, completely irrelevant unless you happen to the central authority.


Because there is so much money for kindergarten teachers, paying an extra salary for a software dev for every kindergarten will certainly lead to better outcomes. The computer programs will make up for the lost teacher economically by teaching the children instead of people, raising the market share of my local kindergarten, or enticing people to have more babies. \s


This is very short sighted, and ignores the lethal trifecta insight.

The LLM doesn’t need to know what it is actually doing (it might think it is searching the web, installing a dev tool, or sending observability data (like metrics), when it is actually sending your API keys to an attacker (maybe in addition to what it thinks it is doing to keep it in the dark).

There have been some very clever things done I’ve seen… even a human reading the transcript may be surprised anything bad happened.


The LLM would never have access to any API keys to send to the attacker. You send text to the LLM along with the prompt and it sends back JSON. You then send the JSON to your traditionally coded API. It’s not like your API has a function “returnAPIKeys()”.

As far as the LLM call, you are just sending your users text to another function that calls the LLM and reading the response back from the LLM.

If it didn’t create JSON you expected, your traditionally coded API is going to fail.

I keep wondering how are developers using LLMs in production and not doing this simple design pattern


Oh man, this made me do a quick search on github. Looks like I picked the wrong week to stop quoting Zucker Brothers films.


> I see no problem with betting on who will win a sports match...

I do wonder - what if the sports teams or politician loses intentionally; which could either be to profit off the loss or due to threats from an actor who seeks to profit?

I heard that Kalshi paid out for when Khamenei was killed in Iran (the bet was for when he would go out of power), so murdering people could be another way to win such a bet on who will lose. Even injuring a sports player could easily change a game result. With so much money on the line, it doesn't seem like a good mix.


This argument is also explored by the “Quantum Computing for the Very Curious” series that uses spaced repetition to teach an advanced topic. The series has been posted to HN more than once.

I also find it convincing.


There is no real such thing as a read only GET request if we are talking about security issues here. Payloads with secrets can still be exfiltrated, and a server you don’t control can do what it wants when it gets the request.


Is the customer actually a chat bot though? That brand is renamed, but maybe after the training cutoff date.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: