schadeautos.nl
robots.txt

Robots Exclusion Standard data for schadeautos.nl

Resource Scan

Scan Details

Site Domain schadeautos.nl
Base Domain schadeautos.nl
Scan Status Ok
Last Scan2024-11-15T01:59:52+00:00
Next Scan 2024-11-22T01:59:52+00:00

Last Scan

Scanned2024-11-15T01:59:52+00:00
URL https://schadeautos.nl/robots.txt
Domain IPs 2a02:2968::1c00:3aff:fe00:df8, 62.84.245.92
Response IP 62.84.245.92
Found Yes
Hash bc815d64ab82a0c001a2c80ea29eb0393b0b8bb44802b2a58da8845391824fc2
SimHash 49148942c651

Groups

*

Rule Path
Allow /
Disallow /sa_ep_*
Disallow /*?

linguee

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.schadeautos.nl/sitemap.xml