n49.com
robots.txt

Robots Exclusion Standard data for n49.com

Resource Scan

Scan Details

Site Domain n49.com
Base Domain n49.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-28T02:30:14+00:00
Next Scan 2024-12-27T02:30:14+00:00

Last Successful Scan

Scanned2024-05-09T02:25:33+00:00
URL https://n49.com/robots.txt
Redirect https://www.n49.com/robots.txt
Redirect Domain www.n49.com
Redirect Base n49.com
Domain IPs 44.215.13.48, 54.205.249.193
Redirect IPs 44.215.13.48, 54.205.249.193
Response IP 44.215.13.48
Found Yes
Hash d721ff3ab81cc45914e1ab22363c289a15136855e90a2b4a810ed908f986b743
SimHash 8316fa73cab2

Groups

*

Rule Path
Disallow /edit-biz/
Disallow /actions.php
Disallow /count.php
Disallow /swf/
Disallow /facebook/
Disallow /xr/
Disallow /review-process/

Other Records

Field Value
crawl-delay 5

scoutjet

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300

adidxbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

geniebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

omniexplorer_bot

Rule Path
Disallow /

spock

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

Warnings

  • 6 invalid lines.