Ok, so I've got a Windows 95 machine which tells me "Windows has detected a registry configuration error", and prompts me to boot into safemode at the boot menu. The problem is, it won't boot into ...

The Event Viewer logs events that lead to errors. The event logs can help you understand what triggered or where exactly the issue is coming from so you can be apply the relevant troubleshooting steps ...