Log In Sign Up

celtascortos.org
robots.txt

Robots Exclusion Standard data for celtascortos.org

Resource Scan

Scan Details

Site Domain celtascortos.org
Base Domain celtascortos.org
Scan Status Ok
Last Scan2025-10-26T03:36:37+00:00
Next Scan 2025-11-02T03:36:37+00:00

Last Scan

Scanned2025-10-26T03:36:37+00:00
URL https://celtascortos.org/robots.txt
Domain IPs 46.29.48.88
Response IP 46.29.48.88
Found Yes
Hash 1730799b5f7d92dcd909cba8a0302125c7ab46727a12fa3092c9fd70021a8965
SimHash 61167010c752

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

applebot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

libwww

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

httrack

Rule Path
Disallow /

yeti

Rule Path
Disallow /

noxtrumbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

slurp

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

libwww

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

httrack

Rule Path
Disallow /

yeti

Rule Path
Disallow /

noxtrumbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10
Back to top