mediummaria.com
robots.txt

Robots Exclusion Standard data for mediummaria.com

Resource Scan

Scan Details

Site Domain mediummaria.com
Base Domain mediummaria.com
Scan Status Ok
Last Scan2024-05-19T02:19:58+00:00
Next Scan 2024-06-18T02:19:58+00:00

Last Scan

Scanned2024-05-19T02:19:58+00:00
URL https://mediummaria.com/robots.txt
Redirect https://www.mediummaria.com/robots.txt
Redirect Domain www.mediummaria.com
Redirect Base mediummaria.com
Domain IPs 104.26.0.66, 104.26.1.66, 172.67.73.212, 2606:4700:20::681a:142, 2606:4700:20::681a:42, 2606:4700:20::ac43:49d4
Redirect IPs 104.26.0.66, 104.26.1.66, 172.67.73.212, 2606:4700:20::681a:142, 2606:4700:20::681a:42, 2606:4700:20::ac43:49d4
Response IP 172.67.73.212
Found Yes
Hash ecd8dded71d86889228a4eaec7b99901e2a1c0aaa6aa1fc3f8f0b2733b676a8f
SimHash a814fd18eedc

Groups

*

Rule Path
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /themes/
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /logout/
Disallow /node/add/
Disallow /search/
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=logout%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /activation_request.html
Disallow /unsubscribe_acknowledgment.html
Disallow /acknowledgment_free_offer.html
Disallow /acknowledgment-free-3-tarot-cards.html
Disallow /free-three-tarots.html
Disallow /3-free-tarot-cards.html
Disallow /3-free-tarot-cards-I.html
Disallow /3-free-tarot-cards-II.html
Disallow /acknowledgment-complete-study.html
Disallow /acknowledgment-7-card-tarot.html
Disallow /acknowledgment-light-contact.html
Disallow /acknowledgment-secrets-of-numerology.html
Disallow /complete-lucky-numbers-hp.html
Disallow /complete-lucky-number-study-I.html
Disallow /complete-lucky-number-study-II.html
Disallow /complete-lucky-number-study-III.html
Disallow /complete-lucky-number-study-IV.html
Disallow /complete-lucky-number-study-V.html
Disallow /complete-lucky-number-study-VI.html
Disallow /complete-lucky-numbers.html
Disallow /seven-tarots.html
Disallow /great-7-card-tarot-reading-I.html
Disallow /great-7-card-tarot-reading-II.html
Disallow /great-7-card-tarot-reading-III.html
Disallow /great-7-card-tarot-reading-IV.html
Disallow /great-7-card-tarot-reading-V.html
Disallow /great-7-card-tarot-reading-VI.html
Disallow /love.html
Disallow /money.html
Disallow /anxiety.html
Disallow /influence.html
Disallow /solitude.html
Disallow /luck.html
Disallow /telepathic-contacts.html
Disallow /request-6-sessions-light-contact-I.html
Disallow /request-6-sessions-light-contact-II.html
Disallow /request-6-sessions-light-contact-III.html
Disallow /request-6-sessions-light-contact-IV.html
Disallow /request-6-sessions-light-contact-V.html
Disallow /request-6-sessions-light-contact-VI.html
Disallow /guide-email-gmail-en.html
Disallow /guide-email-hotmail-en.html
Disallow /guide-email-en.html
Disallow /guide-email-yahoo-en.html
Disallow /unsubscribe.html
Disallow /secure-payment.html
Disallow /secure_payment_g2s.html
Disallow /secure_payment.html
Disallow /ecampaign.html
Disallow /ecampaign_form.html
Disallow /ar_loy
Disallow /eproduct.html
Disallow /epresent.html
Disallow /*?
Disallow /modules/
Disallow /loyalty.php
Disallow /sites/
Disallow /taxonomy/
Disallow /nodes/
Disallow /activation-request.html
Disallow /acknowledgment-free-offer.html
Disallow /free-offer-2.html
Disallow /cart.html
Disallow /wrapper.php
Disallow /click/

Other Records

Field Value
crawl-delay 10

Comments

  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)