Log In Sign Up

mastinell.com
robots.txt

Robots Exclusion Standard data for mastinell.com

Resource Scan

Scan Details

Site Domain mastinell.com
Base Domain mastinell.com
Scan Status Ok
Last Scan2025-10-12T20:44:25+00:00
Next Scan 2025-11-11T20:44:25+00:00

Last Scan

Scanned2025-10-12T20:44:25+00:00
URL https://mastinell.com/robots.txt
Redirect https://www.mastinell.com/robots.txt
Redirect Domain www.mastinell.com
Redirect Base mastinell.com
Domain IPs 178.211.133.77
Redirect IPs 2600:9000:2894:2200:f:d632:5740:93a1, 2600:9000:2894:2800:f:d632:5740:93a1, 2600:9000:2894:3a00:f:d632:5740:93a1, 2600:9000:2894:4000:f:d632:5740:93a1, 2600:9000:2894:5c00:f:d632:5740:93a1, 2600:9000:2894:5e00:f:d632:5740:93a1, 2600:9000:2894:b200:f:d632:5740:93a1, 2600:9000:2894:c400:f:d632:5740:93a1, 3.170.229.112, 3.170.229.49, 3.170.229.57, 3.170.229.83
Response IP 3.170.229.83
Found Yes
Hash b87da142cfcd632c4d2767da9ccc04b237ffb953a5eb249e07cfa992536e4a58
SimHash 6844db90c5c1

Groups

*

Rule Path
Disallow /bookingstep1/
Disallow /*/bookingstep1/
Disallow /bookingstep2/
Disallow /*/bookingstep2/
Disallow /bookingstep3/
Disallow /*/bookingstep3/
Disallow /*?
Disallow /?s=
Disallow /search
Disallow /trackback
Disallow /*trackback
Disallow /*trackback*
Disallow /*/trackback
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

googlebot

Rule Path
Allow /*.css$
Allow /*.js$

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.mastinell.com/sitemap_index.xml
Back to top

Comments

  • DEVELOPED BY MIRAI
  • ---------------------------
  • Dynamic urls
  • Search
  • Trackbacks
  • Feed
  • Slowdown
  • GoogleBot CSS & JS
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top