smartquranacademy.com
robots.txt

Robots Exclusion Standard data for smartquranacademy.com

Resource Scan

Scan Details

Site Domain smartquranacademy.com
Base Domain smartquranacademy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-23T11:46:32+00:00
Next Scan 2025-10-07T11:46:32+00:00

Last Successful Scan

Scanned2025-09-08T09:06:27+00:00
URL https://smartquranacademy.com/robots.txt
Domain IPs 2a02:4780:84:af79:96b5:b003:2986:573, 2a02:4780:84:fb2:fe2c:d5fe:1000:9966, 77.37.115.157, 77.37.75.134
Response IP 191.101.228.199
Found Yes
Hash 5ffc737878e63087f701605030e5787f65a21bf66b34e724f46201a836e87b9b
SimHash 62489b33c5a0

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /vendor/
Disallow /fonts/
Disallow /js/
Disallow /wp-content/plugins/
Disallow /cgi-bin/
Disallow /amp/
Disallow /*/amp/
Disallow /images/icons/
Disallow /*?*
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://smartquranacademy.com/sitemap_index.xml

Comments

  • Block vendor, fonts, js, plugin directories
  • Block AMP URLs if not used
  • Block icons and unnecessary images folders (but keep uploads open for SEO images)
  • Block all URLs with query parameters to prevent self-generated duplicate URLs
  • Allow media library images to be indexed