whatismybrowser.com
robots.txt

Robots Exclusion Standard data for whatismybrowser.com

Resource Scan

Scan Details

Site Domain whatismybrowser.com
Base Domain whatismybrowser.com
Scan Status Ok
Last Scan2024-09-19T14:37:06+00:00
Next Scan 2024-09-26T14:37:06+00:00

Last Scan

Scanned2024-09-19T14:37:06+00:00
URL https://whatismybrowser.com/robots.txt
Redirect https://www.whatismybrowser.com/robots.txt
Redirect Domain www.whatismybrowser.com
Redirect Base whatismybrowser.com
Domain IPs 3.234.18.49, 3.234.51.167
Redirect IPs 3.234.18.49, 3.234.51.167
Response IP 3.234.51.167
Found Yes
Hash fd3e2c11f77e8793730b0fffbe286111b0a8d9387bfa783f6104f763a033d21b
SimHash 091d5137df51

Groups

semrushbot
blexbot
baidu
mauibot
ccbot
petalbot
proximic
mj12bot
siteimprove
criteobot/0.1

Rule Path
Disallow /

*

Rule Path
Disallow /w/
Disallow /out/
Disallow /feature/
Allow /

Other Records

Field Value
sitemap https://www.whatismybrowser.com/sitemap.xml