animenewsnetwork.cc
robots.txt
Robots Exclusion Standard data for animenewsnetwork.cc
Resource Scan
Scan Details
| Site Domain | animenewsnetwork.cc |
| Base Domain | animenewsnetwork.cc |
| Scan Status | Ok |
| Last Scan | 2024-11-10T01:37:40+00:00 |
| Next Scan | 2024-11-17T01:37:40+00:00 |
Last Scan
| Scanned | 2024-11-10T01:37:40+00:00 |
| URL | https://animenewsnetwork.cc/robots.txt |
| Redirect | https://www.animenewsnetwork.com/robots.txt |
| Redirect Domain | www.animenewsnetwork.com |
| Redirect Base | animenewsnetwork.com |
| Domain IPs | 104.21.3.57, 172.67.130.71, 2606:4700:3032::6815:339, 2606:4700:3032::ac43:8247 |
| Redirect IPs | 104.23.128.5, 104.23.132.4, 2606:4700:11::6817:8005, 2606:4700:11::6817:8404 |
| Response IP | 104.23.128.5 |
| Found | Yes |
| Hash | e7c91d8f60876f9549b2909c908e0a2e4b8a466373c48b50381ba6542ffbd705 |
| SimHash | 4d768aa6e6e1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sponsor/ |
| Disallow | /show.aframe |
| Disallow | /logger |
| Disallow | /video/*/adconfig.xml |
| Disallow | /video/ |
| Disallow | /encyclopedia/error-report.php |
| Disallow | /encyclopedia/new- |
| Disallow | /encyclopedia/anime- |
| Disallow | /encyclopedia/releases.php?*yearmonth= |
| Disallow | /encyclopedia/releases.php?*anime= |
| Disallow | /encyclopedia/releases.php?*format= |
| Disallow | /encyclopedia/releases.php?*new= |
| Disallow | /encyclopedia/releases.php?*sort= |
| Disallow | /MyAnime/*sort%3D |
| Disallow | /MyManga/*sort%3D |
| Disallow | /encyclopedia/*%26lookup%3D |
| Disallow | /encyclopedia/reports |
| Disallow | /encyclopedia/api.xml |
| Disallow | /encyclopedia/search/ |
| Disallow | /bbs/phpBB2/profile.php |
| Disallow | /bbs/phpBB2/search.php |
| Disallow | /search |
| Disallow | /?t= |
| Disallow | /cms/changelog/ |
| Disallow | /staff.php |
| Disallow | /account/ |
| Disallow | /admin/ |
| Disallow | /bbs/phpBB2/login.php |
| Disallow | /bbs/phpBB2/posting.php |
| Disallow | /encyclopedia/admin |
| Disallow | /encyclopedia/addinfo |
| Disallow | /encyclopedia/error-report.php?code=*&oldmsg |
| Disallow | /encyclopedia/compare.php |
| Disallow | /MyAnime/anime-set-categ.php |
| Disallow | /MyManga/anime-set-categ.php |
| Disallow | /herald/ |
| Disallow | /newsfeed/getnews.php |
| Disallow | /logev/ |
| Disallow | /rsvp.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /sponsor/ |
| Disallow | /show.aframe |
| Disallow | /logger |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Comments