Mahlanya Dithunya

What if you could take three completely different model families… and distill them into one tiny model? 🤯 📜 Paper: arxiv.org/pdf/2605.21699 MOPD (Multi-Teacher On-Policy Distillation) has become a standard procedure in post-training. We already distill multiple specialized variants of the same model into a single set of weights. But what if we could go further - and distill models from entirely different families? Turns out, it is possible. Today we’re releasing a paper on cross-tokenizer distillation - our first steps in this exciting direction. 📄 We distilled Qwen3-4B, Phi-4-Mini, and Llama-3B into Llama-3.2-1B. MMLU jumped from 32.05 → 46.32 when using multiple teachers. 📈 The team is now working on Nemo-RL integration so the community can try this method in their own settings. Plus, we are scaling experiments up. 🚀

[MURDERER MIDWIFE] Yolande Maritz Fouchee (48), has been sentenced to an effective 23 years' direct imprisonment for a string of crimes against pregnant women, including the death of a 9-days-old baby.

So Eastern Cape has more spaza shops than Gauteng?🤣🤣🤣 You think we smoke socks wena.

@hi_amhigh When you got time google eswatini and Lesotho

Marijuana growing freely in the mountains of Napal, the only place on earth where weed grows naturally over and over

Brandon Petersen's wife on Instagram.

[MTHATA NIU MEMBER GRANTED BAIL FOR MURDER AND BURNING OF VICTIMS’ BODY] 38-year-old Seargent Zamikhaya Mqolo, linked to the Mthatha National Intervention Unit, was today, 27 May 2026, granted R3 000 bail for allegedly killing 37-year-old Bude Phuka and burnt his body afterwards. The incident took place on 02 May 2026 in the town of Indwe near Queenstown. It is alleged by the eye witness who is the girlfriend to the deceased, that on the day of the incident, she was with the deceased at a local liquor establishment where the accused police officer, who is her ex-partner and was off duty, had an argument with the deceased and started assaulting him (the deceased.) She tried to intervene but was overpowered by the accused officer. The deceased decided to leave the liquor establishment in his car. However, the accused officer pursued the deceased in his car. The charred body of deceased was found inside his burnt vehicle on 3 May 2026 on the R56 outside the town of Indwe. R5 cartridges were collected from the scene. As part of its investigation, IPID had to collect DNA samples from the family of Phuka to verify if the charred remains were indeed his. The family has been kept abreast of all developments in the matter and have expressed their gratitude to IPID for the speedy finalisation of the DNA analysis. The case has been remanded to 29 July 2026 to allow for further investigation.

The HSET MMC, Cllr Themba Mvubu, handed over 112 houses to families affected by flooding in Cornubia, Ward 102. Register To Vote EFF In The 2026 Local Government Elections To Be Held On The 4th of November 2026 Link: registertovoteeff.org.za

WANTED SUSPECT LINKED TO MURDER AND BUSINESS ROBBERY: Do Not Approach Authorities are appealing to the public for assistance in identifying and locating a suspect wanted in connection with serious crimes including murder, business robbery, and attempted murder.

Linux kernel explained

Jensen Huang would be very proud right now.

Report spaza shops charging you extra when using your credit or debit cards. Log a complaint with PASA 012 065 1950 or 010 140 7100

NEW: AI consultant reveals a client accidentally spent $500,000,000.00 in a single month after failing to set employee limits on Claude usage.

We THANK YOU for your service to the Amakhosi! Love & Peace!

Lock him up !!🤧😩

They robbed this lady yesterday at Nellmephius, Pretoria, she is so calm and has survival instincts 😢😢

Comrades let’s find this scumbag! 🤧

That R500 Million from Stella Ndabeni Abrahams that disappeared Couldn’t even reach these Queens and supply them with stock and containers 😭😭😭

This Is a school in Sterkspruit Senqu Municipality under ANC just got a clean Audit last week… 😭😭

The moment of truth has arrived! Mr. Moloto confronts Clement about his out-of-control drug addiction. Can he turn his life around? Keep watching to find out!📺🔥🔥🔥 #SkeemSaam

Me ko majiteng