otakustream.tv
robots.txt

Robots Exclusion Standard data for otakustream.tv

Resource Scan

Scan Details

Site Domain otakustream.tv
Base Domain otakustream.tv
Scan Status Ok
Last Scan2024-06-24T05:03:09+00:00
Next Scan 2024-07-01T05:03:09+00:00

Last Scan

Scanned2024-06-24T05:03:09+00:00
URL https://otakustream.tv/robots.txt
Domain IPs 104.21.18.163, 172.67.182.189
Response IP 104.21.18.163
Found Yes
Hash 8b81c58718067e3e97a93bf8235910f8acc6aaadbe7286f59e0f13a9e7225c66
SimHash 6101d230c392

Groups

*

Rule Path
Disallow /player.php
Disallow /player.php*
Disallow /user/
Disallow /user/*
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 5