OpenAI's GPT models can often be fooled into declaring that "pseudo-literary" nonsense is great, a German researcher has found.
Christoph Heilig said he discovered that they consistently rated "nonsense" higher -- including when their so-called "reasoning" features were activated -- which could have stark implications for the development of artificial intelligence.
kAmQxEVD G6CJ :>A@CE2?E E92E H6 E2=< 23@FE H92E 92AA6?D H96? H6 5@?VE 3F:=5 px 2D 2 ?6FEC2=[ C@3@E:4 96=A6C @C 2DD:DE2?EQ 2?5 D66< E@ :?DE:= 9F>2?\=:<6 26DE96E:4 2?5 >@C2= ;F586>6?ED[ E96 24256>:4 2E |F?:49VD {F5H:8 |2I:>:=:2? &?:G6CD:EJ E@=5 pu!]k^Am
kAmw:D C6D62C49 AC6D6?E65 E96 >@56=D H:E9 :?4C62D:?8=J 72C\76E4965 G2C:2E:@?D @7 2 D:>A=6 E6IE[ 2D<:?8 E96> E@ C2E6 D6?E6?46D @FE @7 `_ 7@C =:E6C2CJ BF2=:EJ]k^Am
kAmw6 DE2CE65 H:E9 2 G6CJ D:>A=6 E6IEi Q%96 >2? H2=<65 5@H? E96 DEC66E] xE H2D C2:?:?8] w6 D2H 2 DFCG6:==2?46 42>6C2]Qk^Am
kAmw6 C6A62E65 E96 E6DED >2?J E:>6D[ 2=E6C:?8 E96 A9C2D6D E@ :?4=F56 H@C5D 5C2H? 7C@> 42E68@C:6D DF49 2D 3@5:=J C676C6?46D[ 7:=> ?@:C\DEJ=6 2E>@DA96C6 2?5 E649?:42= ;2C8@?]k^Am
kAm%96 >@DE 6IEC6>6 E6DE A9C2D6D H6C6 2=>@DE E@E2= Q?@?D6?D6Q[ DF49 2D Qv@6EE6C526>>6CF?8VD 4@CAFD 926>@CC92865 E9C@F89 4CJAE@8C2A9:4 92D9[ 6D492E@? A@@=:?8 :? 6I:DE6?E:2= G@:5 36?62E9 7=F@C6D46?E 9F>] !9@E@?D H9:DA6C:?8 AC2J6CDQ \\ H9:49 :E C2E65 9:89=J]k^Am
kAmQ}@?D6?D6Q 4@F=5 2=D@ A@D:E:G6=J @C ?682E:G6=J :?7=F6?46 v!%VD C6DA@?D6D H96? :E H2D 25565 E@ 2? 2C8F>6?E E96 px H2D 2D<65 E@ 6G2=F2E6]k^Am
kAmQ(92E >J 6IA6C:>6?E 567:?:E6=J D9@HD :D E92E E96 >@C6 H6 >@G6 E@H2C5D :?56A6?56?E=J 24E:?8 WpxX 286?ED]]] E96 >@C6 H6 3C:?8 26DE96E:4D :?E@ A=2J[ E96 >@C6 H6V== 92G6 286?ED E92E D66> :CC2E:@?2= E@ FD 9F>2? 36:?8D[Q w6:=:8 D2:5]k^Am
kAmw6 25565 E92E D:?46 px >@56=D 2C6 :?4C62D:?8=J FD65 E@ ;F586 6249 @E96CVD H@C< 2D 4@>A2?:6D 56G6=@A ?6H DJDE6>D[ E9:D 2?5 D:>:=2C 67764ED 4@F=5 36 A2DD65 @? E9C@F89 >F=E:A=6 G6CD:@?D \\ 2D 96 7@F?5 :? 9:D E6DE:?8]k^Am
kAmw:D C6D62C49[ H9:49 :D J6E E@ 36 A66C\C6G:6H65[ E6DE65 ~A6?pxVD =2E6DE v!% >@56=D[ 7C@> v!%\d \\ C6=62D65 :? pF8FDE \\ E@ E96 G6CJ =2E6DE v!%\d]c]k^Am
kAmp7E6C AF3=:D9:?8 56E2:=D @7 2 D:>:=2C 6IA6C:>6?E :? pF8FDE[ w6:=:8 D2:5 96 ?@E:465 v!% 42==:?8 D@>6 @7 9:D DA64:7:4 E6DE A9C2D6D 2 Q=:E6C2CJ 6IA6C:>6?EQ \\ DF886DE:?8 D@>6@?6 2E ~A6?px 925 E2<6? ?@E:46 2?5 >@5:7:65 E96 492E3@E E@ C64@8?:D6 E96>]k^Am
k9am\ V#:A6 7@C 6IA=@:E2E:@?V \k^9am
kAmQ%9:D :D 2 H2J :? H9:49 px 42? 92G6 :ED C2E:@?2= ;F58>6?E D9@CE 4:C4F:E65[Q D2:5 w6?CJ $96G=:?[ 2DD@4:2E6 5:C64E@C @7 E96 &?:G6CD:EJ @7 r2>3C:586VD {6G6C9F=>6 r6?EC6 7@C E96 uFEFC6 @7 x?E6==:86?46[ H9@ H2D ?@E :?G@=G65 :? E96 C6D62C49]k^Am
kAmQqFE :EVD ;FDE ?@E 4=62C E@ >6 E92E :EVD D@ G6CJ 5:776C6?E 7@C 9F>2? 36:?8D[Q 96 25565]k^Am
kAmQ(6 D9@F=5 6IA64E {{|D W=2C86 =2?8F286 >@56=DX E@ 92G6 C62D@?:?8 2?5 4@8?:E:G6 3:2D6D 2?5 =:>:E2E:@?D]]] 3642FD6 2=>@DE 2== 7@C>D @7 :?E6==:86?46[ 2=>@DE 2== 7@C>D @7 C62D@?:?8 2C6 8@:?8 E@ 6I9:3:E 3=:?5 DA@ED 2?5 3:2D6D]QÂ k^Am
kAm%96 DA64:7:4 67764E 7@F?5 3J w6:=:8 4@F=5 >62? E92E QAC@46DD6D H:E9 =:EE=6 9F>2? @G6CD:89EQ @7 px H@C< 2C6 =67E QC:A6 7@C 6IA=@:E2E:@?Q[ $96G=:? D2:5 \\ 8:G:?8 E96 6I2>A=6 @7 24256>:4 ;@FC?2=D E92E FD6 {{|D E@ C6G:6H DF3>:DD:@?D]k^Am
kAmE83^78k^Am
