zeppan.com
robots.txt

Robots Exclusion Standard data for zeppan.com

Resource Scan

Scan Details

Site Domain zeppan.com
Base Domain zeppan.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-08-22T03:57:49+00:00
Next Scan 2024-10-21T03:57:49+00:00

Last Successful Scan

Scanned2024-06-24T03:56:58+00:00
URL https://zeppan.com/robots.txt
Redirect https://www.mangaz.com/robots.txt
Redirect Domain www.mangaz.com
Redirect Base mangaz.com
Domain IPs 18.176.108.158, 54.248.5.4
Redirect IPs 3.113.103.220, 3.114.149.181
Response IP 3.113.103.220
Found Yes
Hash c87d4841fd5bc948fc084d0d8aec1d0b7e84f7febf92eff91d2715fe278d9a35
SimHash 6300d208b7f5

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mediapartners-google*

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /
Allow /icon.svg

yahoo-mmcrawler

Rule Path
Disallow /

psbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /tl/title/
Disallow /images/
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /*.png$
Disallow /*.gif$

Other Records

Field Value
crawl-delay 120

Comments

  • User-agent: Twitterbot
  • Disallow: /
  • GoogleImage
  • YahooImage
  • MSNpicsearch
  • Huawei