mygutfeeling.eu
robots.txt

Robots Exclusion Standard data for mygutfeeling.eu

Resource Scan

Scan Details

Site Domain mygutfeeling.eu
Base Domain mygutfeeling.eu
Scan Status Ok
Last Scan2024-10-16T06:19:34+00:00
Next Scan 2024-10-23T06:19:34+00:00

Last Scan

Scanned2024-10-16T06:19:34+00:00
URL https://mygutfeeling.eu/robots.txt
Domain IPs 94.126.171.155
Response IP 94.126.171.155
Found Yes
Hash 9f1b5e65b60205701182afbc45246db2a2af77c229a66b8b2c72afeb3698c957
SimHash 6e0df906e391

Groups

*

Rule Path
Disallow /?attachment_id
Disallow /attachment/
Disallow /attachment/*
Disallow /members/
Disallow /membros/
Disallow /readme.html
Disallow /refer/
Disallow /page/
Disallow /page/*
Disallow /undefined/*
Disallow /undefined/
Disallow */comment-subscriptions/*
Disallow /comment-subscriptions/*
Disallow /*.php$

Other Records

Field Value
crawl-delay 10

Comments

  • Paths (no clean URLs)