What does the community want regarding AI generated content in the forum

That may or may not be true. We had a lot of publicity some time back about the biases of AI based on its programming and based upon the prompts (similar to the bias in polls based upon the questions).

Consequently, the first problem in any product of its use is whether it is objective in that particular case and to what degree if so. And even more problematic: what are the protocols for deciding?

5 Likes

what I’m saying is:
if our real wish is to have a lot of human to human interaction, then it absolutely doesn’t matter if AI is very smart or very stupid
we should say our wishes directly, like SomeGoGuy ,
don’t say possibly incorrect things about AI instead of it

5 Likes

Certainly. But if you and I are debating some point on this forum, then unlike either of us chatgpt has no prior interest in supporting or refuting the point. It has all sorts of other biases of course, but it has no horse in the race, so to speak.

1 Like

Perhaps a corollary to this…

Unless one is testing and calibrating a Go-playing algorithm, watching it play against another algorithm becomes tiring rather quickly.

If this ever becomes the prevalent future of Go, it won’t likely be of any interest to anyone in another thousand years.

But part of human interaction is talking about outside world. AI became part of outside world.

And I’m saying: some of things that some people think AI can’t do now, AI actually already can. They didn’t try the best models, they didn’t read how they work.
Some things AI indeed still can’t do, but it will in the future.

2 Likes

Yes, it is itself a horse in the race, dragged in by one of the people in the discussion. And since computers command more reverence than people, that is a tactical move.

3 Likes

But how would you use it to support an argument? This seems to cover a lot of ground.

I’d argue it would be bad to quote it either way; if you have doubled checked the evidence against some other source just quote the other source.

But does it need to be posted on the forums? If anyone is in need of a summary they can easily get it themselves. Not allowing these posts dosn’t have much of an impact on those who want one.

With conversations between humans the question of accurately representing another user may arise. When I see the AI summaries brought out, instead of helping to resolve that question, the question of whether or not the AI itself is making mistakes and misrepresenting someone arises.

Look at your recent use of a summary in the thread Do we really need a chess.com for Go? It didn’t really help the conversation, instead it started conversations about the reliability of the AI:

Additionally, it didn’t really help your argument at all. In the thread you said ā€œthis thread is all about how it’s a nefarious scheme to crush OGS and force players to scroll through ads before they can play their next moveā€. You used an AI summary to back this up because people questioned how true this statement was:

But, as some users have asked, how can we trust the AI? As you said above, the basis for trusting it is that it aligns with your own personal assessment of the thread. So your own personal assesment of the thread is supported by the AI, and the AI’s claims were trustworthy because they aligned with your own personal assessment. This is circular.

I point this out because this is an example of exactly why we shouldn’t allow AI summary posts. Your point ended up being circular, cut out the middle man and you could have done the same thing AI free. With AI the point you made was no better, nor no worse, than if you hadn’t used it at all. In that sense it was superfluous, but worse it started this whole side discussion about the trustworthiness of AI.

This is the kind of thing we are going to deal with if we allow AI summaries to be posted. We will keep having discussions about whether or not someone is being misrepresented or some other factual claim is right or wrong. We may already have this issue with other humans, but this kind of use just exacerbates the issue. Instead of arguing that a human is misrepresenting the situation, we’ll have arguments about whether a human is misrepresenting the situation AND arguments about whether the AI is as well.

4 Likes

Well that’s more so because it has come up before and was in discussion already.

If the community voted (and I’m not sure this vote covers it) to allow AI summaries and things, well I won’t be bringing it up, except maybe to point to the result of the vote if there’s disagreement.

But I think I see what you and Conrad are saying about how one might call it an outside perspective or unbiased but it might be more likely to be posted when it’s favourable or agrees with the poster (not commenting on any user or post). That and how it can come across authoritative.

I wouldn’t like it, but I wouldn’t bring up the fact that I want it banned either. But if the AI makes a claim you think is false, would you push back against that?

I think we need a new poll which makes it clear we’re talking about LLM’s

In this post, ā€œAIā€ should be interpreted as generative AI, especially LLMs and Image Generators, not domain-specific AI like Katago

  • Allow AI Translation
  • Allow AI Translation Only if Clearly Labeled
  • Disallow AI Translation
0 voters
  • Allow AI Thread/Post Summaries
  • Allow AI Thread/Post Summaries Only if Clearly Labeled
  • Disallow AI Thread/Post Summaries
0 voters
  • Allow Posts Whose Primary Content is AI Generated (for purposes other than as above)
  • Allow Posts Whose Primary Content is AI Generated (for purposes other than as above) Only if Clearly Labeled
  • Allow Quoting AI in Posts if the Post Also Contains Non-trivial Human-Written Content (for purposes other than as above)
  • Allow Quoting AI in Posts if the Post Also Contains Non-trivial Human-Written Content (for purposes other than as above) Only if Clearly Labeled
  • Disallow Using AI in Posts (for purposes other than as above)
0 voters
  • Allow All AI Use in Threads Explicitly About AI as an Exception to any Restrictions Above
  • Allow All AI Use in Threads Explicitly About AI as an Exception to any Restrictions Above, So Long as it is Clearly Labeled
  • Threads Explicitly About AI Must Adhere to the Same Rules Regarding AI Use as Other Threads
  • Other
0 voters
1 Like

What does it mean?

What if I use Google Translate to translate particular words? Should I mark every single word?

Should I write something like

What if I use Google Translate to translate (source AI: translator) particular (source AI: translator) words?

Or

What if I use Google Translate to translate particular words? (The content generated with help of AI: translator)

I don’t think anyone’s expecting that level of formality. Just a simple ā€œTranslated by DeepLā€ or ā€œTouched up with Google Translateā€ would suffice for ā€œLabeled Clearlyā€, imo, definitely no need to label individual words

2 Likes

I would expect something like ā€œpartlially translated by AIā€ (or better ā€œā€¦ by Google Translateā€).

IMO it can help reduce misunderstandings caused by bad AI translation.

5 Likes

100%. Also a good point that we shouldn’t fault people for typos; this still counts as clearly labeled imo

I think some early patterns which are coming out, is that there is wide agreement that AI is acceptable for translation (though anyone reading the thread could have predicted that), and regardless of other opinions, most people think AI should not be unlabeled (with a possible exception for translation)

1 Like

It’s so textbook the Project and Portfolio Management product we make at my job includes a Risk Register with these fields as part of the default install of useful stuff you’ll probably want.

(maybe this should be in the other thread)

2 Likes

This is a big part of why I generally label it as such on the occasions I do it, though I also try to mitigate the risk by backtranslating it to see if the meaning carried through

3 Likes

I marked ā€œotherā€ as this seems a little under specified. Like I’d want to allow AI within the parameters of the thread, but not necessarily ā€œall use of AIā€

Like a thread called ā€œI generated images based on baduk/weiqi/igoā€ might be filled with AI images, but perhaps not AI commentary.

However, a thread titled ā€œWhat does the community want regarding AIā€ is ā€œExplicitly about AIā€ but should follow the standard rules of the forums.

6 Likes

Good point, I’d agree with your nuances here

2 Likes

prompt? )

I would not consider that non-trivial, as it’s just part of getting the AI output. I mean actual content independent of AI. Actual contribution to the discussion

1 Like