bargaindumpster.com
robots.txt

Robots Exclusion Standard data for bargaindumpster.com

Resource Scan

Scan Details

Site Domain bargaindumpster.com
Base Domain bargaindumpster.com
Scan Status Ok
Last Scan2025-10-21T02:30:31+00:00
Next Scan 2025-10-28T02:30:31+00:00

Last Scan

Scanned2025-10-21T02:30:31+00:00
URL https://bargaindumpster.com/robots.txt
Domain IPs 104.21.87.172, 172.67.145.3, 2606:4700:3030::ac43:9103, 2606:4700:3034::6815:57ac
Response IP 104.21.87.172
Found Yes
Hash 0108f3e36bc3d44bdca5e026662f215afc8d6a1f89b24685db746bcd02798592
SimHash 4f4edac23d93

Groups

*

Rule Path
Allow /
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /tag/
Disallow /*/charleston-south-carolina/*
Disallow /*/chattanooga_tennessee_skyline/
Disallow /category/
Disallow /author/

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://bargaindumpster.com/sitemap.xml
sitemap https://bargaindumpster.com/sitemap_index.xml

Comments

  • This robots.txt file was created by Robots.txt Rewrite plugin: https://wordpress.org/plugins/robotstxt-rewrite/
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.
  • `host` is not a known field.