RankivaBot

The rankiva robot obeys the robot.txt exclusion standard. You can read about it more on Wikipedia and on Robotstxt.

All versions of the robot are labeled with the agent name "Rankivabot". Here are several examples about how you can control the robot by placing the appropriate commands in the robots.txt file:

Hide a folder called 'images' from the Rankivabot:
User-Agent: Rankivabot
Disallow: /images/

Hide a folder called 'images' from the all robotots:
User-Agent: *
Disallow: /images/

Exclude the whole site from being crawled by Rankivabot:
User-Agent: Rankivabot
Disallow: /

Exclude the whole site from being crawled by all robots:
User-Agent: *
Disallow: /

It's also important to note that our robot obeys the per-page index exclusion. If you do not with your homepage to be cached on rankiva, please enter this code in your page header:

Excluding web page caching on www.rankiva.com
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">