schwartz.co.uk
robots.txt

Robots Exclusion Standard data for schwartz.co.uk

Resource Scan

Scan Details

Site Domain schwartz.co.uk
Base Domain schwartz.co.uk
Scan Status Ok
Last Scan2024-08-31T19:17:55+00:00
Next Scan 2024-09-30T19:17:55+00:00

Last Scan

Scanned2024-08-31T19:17:55+00:00
URL https://schwartz.co.uk/robots.txt
Redirect https://www.schwartz.co.uk/robots.txt
Redirect Domain www.schwartz.co.uk
Redirect Base schwartz.co.uk
Domain IPs 52.84.229.107, 52.84.229.26, 52.84.229.32, 52.84.229.67
Redirect IPs 52.84.229.107, 52.84.229.26, 52.84.229.32, 52.84.229.67
Response IP 52.84.229.26
Found Yes
Hash b58cf47536aca3d627eeec45b5027c82bc2ec9529b457f6f3d5d4bbbdf29b747
SimHash c87506b4cf85

Groups

*

Rule Path
Allow /*?$
Disallow /*?
Disallow /bin
Disallow /xsl
Disallow /temp
Disallow /Areas
Disallow /Tests
Disallow /Views
Allow /lyticsbot
Allow /-/media/*
Disallow /Models
Disallow /OLDBAY
Disallow /upload
Disallow /*?item
Disallow /layouts
Disallow /itecore
Disallow /generic
Disallow /*search
Disallow /App_Data
Disallow /sitecore
Disallow /sitemaps
Disallow /App_Config
Disallow /Properties
Disallow /TEMPFOLDER
Disallow /default.js
Disallow /Web.config
Allow /*/bundles/*.js
Disallow /Controllers
Disallow /default.css
Disallow /Global.asax
Disallow /webedit.css
Allow /*/bundles/*.css
Disallow /App_Browsers
Disallow /Dictionaries
Disallow /Default.aspx
Disallow /aspnet_client
Disallow /link.aspx?_id
Disallow /sitecore_files
Disallow /search?pageNum
Disallow /Summertime-Treats
Disallow /Spring_Into_Baking
Disallow /sitemaps/schwartz-sitemap-en-gb.xml

Other Records

Field Value
sitemap https://www.schwartz.co.uk/sitemap.xml

Warnings

  • 3 invalid lines.