vw.mangaz.com
robots.txt

Robots Exclusion Standard data for vw.mangaz.com

Resource Scan

Scan Details

Site Domain vw.mangaz.com
Base Domain mangaz.com
Scan Status Ok
Last Scan2024-10-03T21:05:15+00:00
Next Scan 2024-10-10T21:05:15+00:00

Last Scan

Scanned2024-10-03T21:05:15+00:00
URL https://vw.mangaz.com/robots.txt
Domain IPs 18.177.102.151, 54.249.115.76
Response IP 54.249.115.76
Found Yes
Hash c87d4841fd5bc948fc084d0d8aec1d0b7e84f7febf92eff91d2715fe278d9a35
SimHash 6300d208b7f5

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mediapartners-google*

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /
Allow /icon.svg

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /tl/title/
Disallow /images/
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /*.png$
Disallow /*.gif$

Other Records

Field Value
crawl-delay 120

Comments

  • User-agent: Twitterbot
  • Disallow: /
  • GoogleImage
  • YahooImage
  • MSNpicsearch
  • Huawei