Become Zend Certified

Prepare for the ZCE exam using our quizzes (web or iPad/iPhone). More info...

When you're ready get 7.5% off your exam voucher using voucher CJQNOV23 at the Zend Store

Protecting Content And Handling Robots


Do you want a competitor to grab your web site content within a day? Have you ever had your server stall or bandwidth limit exceeded from an unknown robot rapidly crawling many thousand pages an hour? Do visitors complain because you had to block their ISP’s IP, and they do not have access to your site? These problems may seem not so critical until you develop a site with a hundred thousand pages or bigger.

This tutorial provides a solution for big sites to:

  • Protect their content against mass download software
  • Handle search robots
  • Prevent unauthorized user activity
  • Save bandwidth.

A working example of the code produced in this article can be found at

You can download the code produced in this article at

In This Article