If you absolutely must download Office 2003 Portable, run it inside a virtual machine or a Windows Sandbox. Never open it on your main PC. The software that "works better" rarely includes antivirus definitions from 2009.
While some report it works on Windows 10/11, others report "setup is corrupted" errors or issues opening/saving files. microsoft office 2003 portable download work better