schwartz.co.uk
robots.txt
Robots Exclusion Standard data for schwartz.co.uk
Resource Scan
Scan Details
Site Domain | schwartz.co.uk |
Base Domain | schwartz.co.uk |
Scan Status | Ok |
Last Scan | 2024-08-31T19:17:55+00:00 |
Next Scan | 2024-09-30T19:17:55+00:00 |
Last Scan
Scanned | 2024-08-31T19:17:55+00:00 |
URL | https://schwartz.co.uk/robots.txt |
Redirect | https://www.schwartz.co.uk/robots.txt |
Redirect Domain | www.schwartz.co.uk |
Redirect Base | schwartz.co.uk |
Domain IPs | 52.84.229.107, 52.84.229.26, 52.84.229.32, 52.84.229.67 |
Redirect IPs | 52.84.229.107, 52.84.229.26, 52.84.229.32, 52.84.229.67 |
Response IP | 52.84.229.26 |
Found | Yes |
Hash | b58cf47536aca3d627eeec45b5027c82bc2ec9529b457f6f3d5d4bbbdf29b747 |
SimHash | c87506b4cf85 |
Groups
*
Rule | Path |
---|---|
Allow | /*?$ |
Disallow | /*? |
Disallow | /bin |
Disallow | /xsl |
Disallow | /temp |
Disallow | /Areas |
Disallow | /Tests |
Disallow | /Views |
Allow | /lyticsbot |
Allow | /-/media/* |
Disallow | /Models |
Disallow | /OLDBAY |
Disallow | /upload |
Disallow | /*?item |
Disallow | /layouts |
Disallow | /itecore |
Disallow | /generic |
Disallow | /*search |
Disallow | /App_Data |
Disallow | /sitecore |
Disallow | /sitemaps |
Disallow | /App_Config |
Disallow | /Properties |
Disallow | /TEMPFOLDER |
Disallow | /default.js |
Disallow | /Web.config |
Allow | /*/bundles/*.js |
Disallow | /Controllers |
Disallow | /default.css |
Disallow | /Global.asax |
Disallow | /webedit.css |
Allow | /*/bundles/*.css |
Disallow | /App_Browsers |
Disallow | /Dictionaries |
Disallow | /Default.aspx |
Disallow | /aspnet_client |
Disallow | /link.aspx?_id |
Disallow | /sitecore_files |
Disallow | /search?pageNum |
Disallow | /Summertime-Treats |
Disallow | /Spring_Into_Baking |
Disallow | /sitemaps/schwartz-sitemap-en-gb.xml |
Other Records
Field | Value |
---|---|
sitemap | https://www.schwartz.co.uk/sitemap.xml |
Warnings
- 3 invalid lines.