official.shinkamigoto.net
robots.txt

Robots Exclusion Standard data for official.shinkamigoto.net

Resource Scan

Scan Details

Site Domain official.shinkamigoto.net
Base Domain shinkamigoto.net
Scan Status Ok
Last Scan2024-11-03T16:36:12+00:00
Next Scan 2024-12-03T16:36:12+00:00

Last Scan

Scanned2024-11-03T16:36:12+00:00
URL https://official.shinkamigoto.net/robots.txt
Domain IPs 183.90.231.197
Response IP 183.90.231.197
Found Yes
Hash 48d2c43cbd7b733968ef20035f4ce688d99376e1b8c6807ea3e7296a305369d0
SimHash 1a84fe6382a1

Groups

*

Rule Path
Disallow /cache/
Disallow /css/
Disallow /errors/
Disallow /font/
Disallow /images/
Disallow /img/
Disallow /js/
Disallow /media/
Disallow /preview/
Disallow /skins/
Disallow /tpl/
Disallow /cmd/
Disallow /cms/
Disallow /i/
Disallow /new/
Disallow /old/
Disallow /*.pdf$
Disallow /*.docx$
Disallow /*.doc$
Disallow /*.xlsx$
Disallow /*.xls$
Disallow /*.zip$
Disallow /*.rtf$
Disallow /*.CSV$
Disallow /*.csv$
Disallow /*_print.php$

semrushbot

Rule Path
Disallow /

superfeedr

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

steeler

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /

linqiascrapebot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

shim-crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

exabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

machiirobot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://official.shinkamigoto.net/sitemap.xml