If humans remembered or focused on IP addresses, we would not need DNS, which is the Domain Name System, which assigns an appropriate domain name to each specific IP address.
Hihi we will just note down every IP and check it like we do crypto addresses.
After a week we will be all talking 87.17.181.11.34.171.18
The ideal way is to modify the host file on your computer and allow visits to specific IP addresses and block any IP address that is not in the file. browsing experience will be bad but safe.
It would be crazy, google itself has about 20 main domains with a ton of IPs, if you plan on still using social media and all 3rd party links on it you will probably waste half a day each month whitelisting IPs, and still even that won't save you if the website itself is compromised and the malware is feed directly.
Unfortunately, the more you secure something the tired you get from actually using that stuff.