Log In Sign Up

ppdb.man2modelmedan.com
robots.txt

Robots Exclusion Standard data for ppdb.man2modelmedan.com

Resource Scan

Scan Details

Site Domain ppdb.man2modelmedan.com
Base Domain man2modelmedan.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-01T02:56:36+00:00
Next Scan 2026-01-30T02:56:36+00:00

Last Successful Scan

Scanned2025-06-11T01:01:24+00:00
URL https://ppdb.man2modelmedan.com/robots.txt
Domain IPs 104.21.79.24, 172.67.168.182, 2606:4700:3030::6815:4f18, 2606:4700:3034::ac43:a8b6
Response IP 104.21.79.24
Found Yes
Hash 30e6c9c6b8872749f585fb00bb001fd0ce7112b34b6d80276ccc4ee8b2731a05
SimHash 3c3776508752

Groups

googlebot

Rule Path
Allow /
Disallow /auth/

mediapartners-google

Rule Path
Allow /
Disallow /auth/

slurp

Rule Path
Allow /
Disallow /auth/

yandex

Rule Path
Allow /
Disallow /auth/

msnbot

Rule Path
Allow /
Disallow /auth/

applebot

Rule Path
Allow /
Disallow /auth/

baiduspider

Rule Path
Allow /
Disallow /auth/

bingbot

Rule Path
Allow /
Disallow /auth/

ia_archiver

Rule Path
Allow /
Disallow /auth/

naverbot

Rule Path
Allow /
Disallow /auth/

seznambot

Rule Path
Allow /
Disallow /auth/

teoma

Rule Path
Allow /
Disallow /auth/

twitterbot

Rule Path
Allow /
Disallow /auth/

yeti

Rule Path
Allow /
Disallow /auth/

alexabot

Rule Path
Allow /
Disallow /auth/

facebot

Rule Path
Allow /
Disallow /auth/

adsbot-google

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://ppdb.man2modelmedan.com/sitemap.xml
Back to top

Comments

  • Google Search Engine Robot
  • Media Partners Google Robot
  • Yahoo! Search Engine Robot
  • Yandex Search Engine Robot
  • Microsoft Search Engine Robot
  • Apple Robot
  • Baidu spider
  • Bing Search Engine Robot
  • Archive.org Robot
  • Korea Search Engine
  • Robot Valid Information
  • Teoma Search Engine Robot
  • Twitter Robot
  • Profesional Designed Robot
  • Alexa Robot
  • Facebook Robot
  • Adsense Robot
  • Every bot that might possibly read and respect this file.
  • the protocol of the sitemap.
Back to top