greatest-quotations.com
robots.txt

Robots Exclusion Standard data for greatest-quotations.com

Resource Scan

Scan Details

Site Domain greatest-quotations.com
Base Domain greatest-quotations.com
Scan Status Ok
Last Scan2024-10-04T15:05:45+00:00
Next Scan 2024-10-11T15:05:45+00:00

Last Scan

Scanned2024-10-04T15:05:45+00:00
URL https://greatest-quotations.com/robots.txt
Domain IPs 86.38.247.195
Response IP 86.38.247.195
Found Yes
Hash 0e1aaac1254a866da68dc9975cdf2e7fb245c8952689c753e768208154472077
SimHash 701fd8e0cadb

Groups

*

Rule Path
Disallow /ajax/
Disallow /appsajax/
Disallow /admin/
Disallow /pages/
Disallow /sendquote.asp

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

hbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /