theworldandthensome.com
robots.txt

Robots Exclusion Standard data for theworldandthensome.com

Resource Scan

Scan Details

Site Domain theworldandthensome.com
Base Domain theworldandthensome.com
Scan Status Ok
Last Scan2026-01-05T12:22:58+00:00
Next Scan 2026-01-12T12:22:58+00:00

Last Scan

Scanned2026-01-05T12:22:58+00:00
URL https://theworldandthensome.com/robots.txt
Redirect https://www.theworldandthensome.com/robots.txt
Redirect Domain www.theworldandthensome.com
Redirect Base theworldandthensome.com
Domain IPs 141.193.213.10, 141.193.213.11
Redirect IPs 141.193.213.10, 141.193.213.11
Response IP 141.193.213.10
Found Yes
Hash b5b07dcb50dc1250fad1877fe11e41e31ac8376fa784b5c758cad61e8a74c4e1
SimHash c968ccc0a49b

Groups

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/

Other Records

Field Value
sitemap https://www.theworldandthensome.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.