Log In Sign Up

filmvandaag.nl
robots.txt

Robots Exclusion Standard data for filmvandaag.nl

Resource Scan

Scan Details

Site Domain filmvandaag.nl
Base Domain filmvandaag.nl
Scan Status Ok
Last Scan2024-11-01T03:25:48+00:00
Next Scan 2024-11-08T03:25:48+00:00

Last Scan

Scanned2024-11-01T03:25:48+00:00
URL https://filmvandaag.nl/robots.txt
Redirect https://www.filmvandaag.nl/robots.txt
Redirect Domain www.filmvandaag.nl
Redirect Base filmvandaag.nl
Domain IPs 34.141.214.221
Redirect IPs 34.141.214.221
Response IP 34.141.214.221
Found Yes
Hash c572967cbfbd4eddefa0c71f2b19cc883db71a6c141efc3cb7c663c9c1e78af6
SimHash ea2c0d748193

Groups

*

Rule Path
Disallow

googlebot-news

Rule Path
Disallow /*
Allow /$
Allow /nieuws
Allow /auteur
Allow /redactie
Allow /sitemaps
Allow /feeds
Allow /api

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.filmvandaag.nl/sitemaps/
Back to top

Comments

  • robots.txt voor FilmVandaag.nl
Back to top