mc.today
robots.txt

Robots Exclusion Standard data for mc.today

Resource Scan

Scan Details

Site Domain mc.today
Base Domain mc.today
Scan Status Ok
Last Scan2024-11-09T12:59:37+00:00
Next Scan 2024-11-16T12:59:37+00:00

Last Scan

Scanned2024-11-09T12:59:37+00:00
URL https://mc.today/robots.txt
Domain IPs 104.26.6.145, 104.26.7.145, 172.67.72.65, 2606:4700:20::681a:691, 2606:4700:20::681a:791, 2606:4700:20::ac43:4841
Response IP 104.26.7.145
Found Yes
Hash ca5ac9e97073ea4e1a10eaf7b452d0457aa2a8c025be332ad8e8fb096bfa58ee
SimHash 6968c6124cef

Groups

*

Rule Path
Allow /wp-admin/js/*
Allow /wp-content/cache/wpfc-minified/*
Allow /wp-content/plugins/*
Allow /wp-content/themes/supermc/*
Allow /wp-includes/js/*
Allow /igaming/assets/*
Allow /igaming/*?*
Allow /uk/feed/
Allow /uk/category/infopryvid/feed/
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-content/themes/supermc/ajax/*
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /type/aside/amp*
Disallow /register*
Disallow /*.pdf
Disallow /*.docx

*

Rule Path
Disallow /wp-content/uploads/wp-import-export-lite/

Other Records

Field Value
sitemap https://mc.today/uk/sitemap.xml
sitemap https://mc.today/uk/sitemap-news.xml
sitemap https://mc.today/sitemap_tag.xml
sitemap https://mc.today/sitemap-image.xml

Comments

  • SDC-1841
  • WP Import Export Rule