needcoffee.com
robots.txt

Robots Exclusion Standard data for needcoffee.com

Resource Scan

Scan Details

Site Domain needcoffee.com
Base Domain needcoffee.com
Scan Status Ok
Last Scan2025-11-28T11:46:54+00:00
Next Scan 2025-12-05T11:46:54+00:00

Last Scan

Scanned2025-11-28T11:46:54+00:00
URL https://needcoffee.com/robots.txt
Domain IPs 185.93.1.250, 2400:52e0:1a00::1069:1
Response IP 185.93.1.250
Found Yes
Hash bdbcc161d9f86f54bc4ab7bda8567ec926d2a4889602f68011755a6dd9e16ef3
SimHash 231ed840a0a3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Allow /

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

istellabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

Other Records

Field Value
sitemap http://www.needcoffee.com/sitemap.xml
sitemap http://www.needcoffee.com/news-sitemap.xml