marketshaperser.com
robots.txt

Robots Exclusion Standard data for marketshaperser.com

Resource Scan

Scan Details

Site Domain marketshaperser.com
Base Domain marketshaperser.com
Scan Status Ok
Last Scan2024-09-05T06:37:23+00:00
Next Scan 2024-10-05T06:37:23+00:00

Last Scan

Scanned2024-09-05T06:37:23+00:00
URL https://marketshaperser.com/robots.txt
Domain IPs 2a00:b0e0:6:5::c6, 85.92.70.198
Response IP 85.92.70.198
Found Yes
Hash ae527a9c2a4a7e16c26eccc1d82eb5a987545a4814a74e02a2516907a580e3ed
SimHash 69124ec6c2b1

Groups

*

Rule Path
Disallow /wp-includes/
Disallow /comments/feed/
Disallow /wp-content/cache/
Disallow /index.php
Disallow /wp-content/themes/
Disallow /tmp/
Disallow /junk/

ninjabot
mediapartners-google*


Rule Path
Allow /

googlebot-image
adsbot-google
googlebot-mobile

No rules defined. All paths allowed.

Other Records

Field Value
sitemap http://marketshaperser.com/sitemap_index.xml

Warnings

  • `
allow` is not a known field.
  • `
disallow` is not a known field.