openneo.net
robots.txt

Robots Exclusion Standard data for openneo.net

Resource Scan

Scan Details

Site Domain openneo.net
Base Domain openneo.net
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-28T10:01:41+00:00
Next Scan 2024-11-26T10:01:41+00:00

Last Successful Scan

Scanned2024-04-08T09:12:16+00:00
URL https://openneo.net/robots.txt
Domain IPs 173.230.135.241
Response IP 173.230.135.241
Found Yes
Hash bd8830a51bf847d1350499963bb3e397a4d1695bffbfd4a2038f76901956b6da
SimHash 765359556d61

Groups

googlebot

Rule Path
Disallow

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://openneo.net/sitemap.xml