highload.today
robots.txt

Robots Exclusion Standard data for highload.today

Resource Scan

Scan Details

Site Domain highload.today
Base Domain highload.today
Scan Status Ok
Last Scan2024-11-08T22:24:08+00:00
Next Scan 2024-11-15T22:24:08+00:00

Last Scan

Scanned2024-11-08T22:24:08+00:00
URL https://highload.today/robots.txt
Domain IPs 104.26.14.112, 104.26.15.112, 172.67.72.17, 2606:4700:20::681a:e70, 2606:4700:20::681a:f70, 2606:4700:20::ac43:4811
Response IP 172.67.72.17
Found Yes
Hash 03576a21c5756a9f8de062cd69b553f9d3b6f4fe7d63fb20ddde939a3b6500d8
SimHash 630cf6864ec6

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-content/themes/supermc/ajax/*
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /type/aside/amp*
Disallow /register*
Disallow */login/
Allow /wp-admin/js/*
Allow /wp-content/cache/wpfc-minified/*
Allow /wp-content/plugins/*
Allow /wp-content/themes/supermc/*
Allow /wp-includes/js/*
Allow /*.js?
Allow /*.css?
Allow /*.jpg?
Allow /*.gif?
Allow /*.png?
Allow /*.jpeg?
Allow /*.webp?

Other Records

Field Value
sitemap https://highload.today/sitemap.xml
sitemap https://highload.today/sitemap-news.xml