courseunity.com
robots.txt

Robots Exclusion Standard data for courseunity.com

Resource Scan

Scan Details

Site Domain courseunity.com
Base Domain courseunity.com
Scan Status Ok
Last Scan2025-10-23T02:31:34+00:00
Next Scan 2025-10-30T02:31:34+00:00

Last Scan

Scanned2025-10-23T02:31:34+00:00
URL https://courseunity.com/robots.txt
Domain IPs 192.250.235.27
Response IP 192.250.235.27
Found Yes
Hash 9902d6a45174eca4bc7c348ee69cee784b173e3ef22364b38514585f67cdb051
SimHash e11ced510680

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /?page=*
Disallow /?tag=*
Disallow /?category=*
Disallow /?tag*
Disallow /?page*
Disallow /?type=*
Disallow /?s=%7Bsearch_term_string%7D
Disallow /?s=*
Disallow /search/
Disallow /page/*/?s=
Disallow /?amp*
Disallow /utm*
Disallow /?utm_source=*
Disallow /?feed_id=*
Disallow /?srsltid=*

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://courseunity.com/sitemap_index.xml
sitemap https://courseunity.com/sitemaps.xml
sitemap https://courseunity.com/video/sitemaps.xml