Log In Sign Up

inaporn.com
robots.txt

Robots Exclusion Standard data for inaporn.com

Resource Scan

Scan Details

Site Domain inaporn.com
Base Domain inaporn.com
Scan Status Ok
Last Scan2024-11-10T06:49:35+00:00
Next Scan 2024-12-10T06:49:35+00:00

Last Scan

Scanned2024-11-10T06:49:35+00:00
URL https://inaporn.com/robots.txt
Domain IPs 192.200.104.227
Response IP 192.200.104.227
Found Yes
Hash d00bd00db4094b9799108bcae90199becab00656cffbc6e572eb9ad9e7a44139
SimHash 021f5c51cab9

Groups

*

Rule Path
Disallow /live/
Disallow /video/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

sogou

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

pimeyes.com crawler

Rule Path
Disallow /
Back to top

Comments

  • User-Agent: AhrefsBot
  • Disallow: /
Back to top

Warnings

  • 1 invalid line.
Back to top