wordpress-estimation-payment-forms.com
robots.txt

Robots Exclusion Standard data for wordpress-estimation-payment-forms.com

Resource Scan

Scan Details

Site Domain wordpress-estimation-payment-forms.com
Base Domain wordpress-estimation-payment-forms.com
Scan Status Ok
Last Scan2025-10-22T12:25:09+00:00
Next Scan 2025-11-21T12:25:09+00:00

Last Scan

Scanned2025-10-22T12:25:09+00:00
URL http://wordpress-estimation-payment-forms.com/robots.txt
Redirect https://wp-cost-estimation-payment-forms.com/robots.txt
Redirect Domain wp-cost-estimation-payment-forms.com
Redirect Base wp-cost-estimation-payment-forms.com
Domain IPs 213.186.33.5
Redirect IPs 79.137.33.21
Response IP 79.137.33.21
Found Yes
Hash 1ddec7f3830aa898b8eccfe411dfc3ee76ac3e9e939e67ea95955adea14e5cd3
SimHash 410eced2e592

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /test

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://wpcostestimation.com/sitemap.xml

Comments

  • Robots.txt for WP Cost Estimation & Payment Forms Builder
  • Sitemap location
  • Crawl-delay for respectful crawling
  • Specific rules for major search engines
  • Block bad bots