Welcome to Our Community

Registration on our forums are now open for some days! Feel free to sign up today.

Robots 1.5

Disallows robots from indexing your site unless explicitly allowed.

  1. Caldexi
    Compatible XF Versions:
    • 1.2
    • 1.3
    • 1.4
    Robots
    1.5
    Description:
    Disallows robots from indexing your site unless explicitly allowed.
    (Robots link in Visitors tab)
    Bj5dYwQ.jpg
    (Example of Robots page)
    q1mWIsZ.jpg
    (Example of Options page)
    VVnbvIU.jpg
    (Example of User Group Permissions)
    Do03KsI.jpg

    Questions and Answers:

    Q: What is the purpose of this add-on?
    A: Lots of robots crawling your forum will slow it down.

    Q: I noticed a robot crawling my site but it's identified as a guest.
    A: You need to add the name to the Robot Names field in the Options.

    Q: What happens if a robot which is not allowed comes to my site?
    A: It receives a blank page.

    Q: Why not use the robots.txt file to restrict robots?
    A: Because 99% of all robots ignore this file.

    Features:
    • All phrases start with robots_ for your convenience.
    Database modifications:
    This add-on will create a table called xf_robots in your database.

    Installation:
    1. Download robots_v1.5.zip and unzip it.
    2. Upload the Andy folder to your server. The correct location is library/Andy.
    3. From your Admin Control Panel, go to the "Install Add-on" page.
    4. Upload the addon-Robots_v1.5.xml file
    5. Click the Install Add-on button.
    MRUK-xD, BenjiB02 and albundy229137 like this.