chefblogger.me
robots.txt

Robots Exclusion Standard data for chefblogger.me

Resource Scan

Scan Details

Site Domain chefblogger.me
Base Domain chefblogger.me
Scan Status Ok
Last Scan2024-10-08T10:03:11+00:00
Next Scan 2024-10-09T10:03:11+00:00

Last Scan

Scanned2024-10-08T10:03:11+00:00
URL https://chefblogger.me/robots.txt
Domain IPs 149.126.4.92, 2a01:ab20:0:4::92
Response IP 149.126.4.92
Found Yes
Hash 6d140b00740567d64a6fe24700061b130db9f9ef535a26eb7e0c264139941b06
SimHash 39448861e593

Groups

*

Rule Path
Allow /wp-content/uploads
Allow /images/
Disallow /__archiv
Disallow /download
Disallow /readme.html
Disallow /twitter/
Disallow /cgi-bin/

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.chefblogger.me/sitemap.xml