mangabox.me
robots.txt

Robots Exclusion Standard data for mangabox.me

Resource Scan

Scan Details

Site Domain mangabox.me
Base Domain mangabox.me
Scan Status Ok
Last Scan2024-06-06T05:24:19+00:00
Next Scan 2024-06-13T05:24:19+00:00

Last Scan

Scanned2024-06-06T05:24:19+00:00
URL https://mangabox.me/robots.txt
Redirect https://www.mangabox.me/robots.txt
Redirect Domain www.mangabox.me
Redirect Base mangabox.me
Domain IPs 52.197.82.110, 52.198.118.177, 54.65.113.210
Redirect IPs 52.197.82.110, 52.198.118.177, 54.65.113.210
Response IP 54.65.113.210
Found Yes
Hash fd2e024cf6e6316bdf0ac67435b1cafe0b4b8dfd7c7dfdb619873cd411f1a71a
SimHash 8922dc378f71

Groups

*

Rule Path
Disallow *.png
Disallow *.jpg
Disallow *.jpeg
Disallow /redirect_to/*
Disallow /auser/*
Disallow /browser/auser/*
Disallow /ad_creative/*

twitterbot
facebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.mangabox.me/www_sitemap.xml
sitemap https://www.mangabox.me/www2_sitemap.xml
sitemap https://www.mangabox.me/www3_sitemap.xml
sitemap https://www.mangabox.me/www4_sitemap.xml
sitemap https://www.mangabox.me/www5_sitemap.xml
sitemap https://www.mangabox.me/www6_sitemap.xml
sitemap https://www.mangabox.me/www7_sitemap.xml
sitemap https://www.mangabox.me/www8_sitemap.xml
sitemap https://www.mangabox.me/www9_sitemap.xml
sitemap https://www.mangabox.me/www10_sitemap.xml
sitemap https://www.mangabox.me/www11_sitemap.xml
sitemap https://www.mangabox.me/www12_sitemap.xml
sitemap https://www.mangabox.me/www13_sitemap.xml
sitemap https://www.mangabox.me/www14_sitemap.xml
sitemap https://www.mangabox.me/www15_sitemap.xml
sitemap https://www.mangabox.me/www16_sitemap.xml
sitemap https://www.mangabox.me/www17_sitemap.xml
sitemap https://www.mangabox.me/www18_sitemap.xml
sitemap https://www.mangabox.me/www19_sitemap.xml
sitemap https://www.mangabox.me/www20_sitemap.xml

Comments

  • generated by the batch file