52 cognitive #bias in French

Jeu de cartes sous licence CC-BY de 52 biais cognitifs en français.

http://olkihost.loria.fr/cerisara/52-cartes-biais-cognitifs-laurence-vagner-stephanie-walter.pdf

New #PhD opportunity in Nancy France on continual learning of large language models:

https://members.loria.fr/CCerisara/#phdANR.html

Don't hesitate to contact us for further details!

#nlp #llm #job

Translating to English before #nlp processing works better than multi-lingual processing; self-translating also works better, although a bit less good, but the delta might decrease with scale.

And if you're looking for a good open translation #llm, NLLB-200 is recommended by the authors:

https://arxiv.org/abs/2308.01223

Scaling laws for 4-bit #llm : https://arxiv.org/abs/2212.09720
It's best to use more parameters with 4-bits, than less parameters in 16-bits.

Also, SpQR improves over QLoRA with good scaling laws:
https://arxiv.org/abs/2306.03078

Another great report on training and finetuning details for Llama2:
https://arxiv.org/abs/2307.09288