alightmotionfx.com
robots.txt

Robots Exclusion Standard data for alightmotionfx.com

Resource Scan

Scan Details

Site Domain alightmotionfx.com
Base Domain alightmotionfx.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-09T20:52:20+00:00
Next Scan 2025-11-08T20:52:20+00:00

Last Successful Scan

Scanned2025-07-11T15:18:58+00:00
URL https://alightmotionfx.com/robots.txt
Domain IPs 104.21.72.87, 172.67.178.192, 2606:4700:3034::6815:4857, 2606:4700:3037::ac43:b2c0
Response IP 172.67.178.192
Found Yes
Hash bb7b359a20cd2d59cba5bbfd62e0432eb837a0f5086e0e1e3a2c243c84be76d4
SimHash 2a204fe3ec31

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /*?sessionid=
Disallow /*?utm_
Disallow /*?ref=
Allow /wp-content/uploads/
Allow /category/
Allow /tag/
Allow /category/*

Other Records

Field Value
sitemap https://alightmotionfx.com/sitemap_index.xml

Comments

  • Rank Math Robots.txt file - Optimized for Crawl Budget and Indexing Tags, Categories, and Empty Categories
  • Block WordPress default pages that are unnecessary for crawlers to visit
  • Block URL parameters (like session IDs) that create duplicate content
  • Allow access to important content like uploads (images, videos, etc.)
  • Allow crawling of category, tag, and archive pages, including empty categories
  • Allow crawling of category pages even if they are empty
  • Allow access to your sitemap and important files