You will have to access your website from the backend. Use the FTP server or CPanel file explorer to locate the 'wp-content/cache' folder. All the website cache is saved inside the 'cache' folder. So, simply empty this folder, and this will delete the site cache.
