libwww-robotrules-perl_6.01-1_all.deb


Advertisement

Description

libwww-robotrules-perl - database of robots.txt-derived permissions

Distribution: Debian 8 (Jessie)
Repository: Debian Main amd64
Package name: libwww-robotrules-perl
Package version: 6.01
Package release: 1
Package architecture: all
Package type: deb
Installed size: 80 B
Download size: 13.98 KB
Official Mirror: ftp.br.debian.org
WWW::RobotRules parses /robots.txt files as specified in "A Standard for Robot Exclusion", at <http://www.robotstxt.org/wc/norobots.html>. Webmasters can use the /robots.txt file to forbid conforming robots from accessing parts of their web site. The parsed files are kept in a WWW::RobotRules object, and this object provides methods to check if access to a given URL is prohibited. The same WWW::RobotRules object can be used for one or more parsed /robots.txt files on any number of hosts.

Alternatives

Requires

Replaces

  • libwww-perl << 6.00

    Download

    Source package: libwww-robotrules-perl

    Install Howto

    1. Update the package index:
      # sudo apt-get update
    2. Install libwww-robotrules-perl deb package:
      # sudo apt-get install libwww-robotrules-perl

    Files

    • /usr/share/doc/libwww-robotrules-perl/changelog.Debian.gz
    • /usr/share/doc/libwww-robotrules-perl/changelog.gz
    • /usr/share/doc/libwww-robotrules-perl/copyright
    • /usr/share/man/man3/WWW::RobotRules.3pm.gz
    • /usr/share/man/man3/WWW::RobotRules::AnyDBM_File.3pm.gz
    • /usr/share/perl5/WWW/RobotRules.pm
    • /usr/share/perl5/WWW/RobotRules/AnyDBM_File.pm

    Changelog

    2011-03-13 - Nicholas Bamber <nicholas@periapt.co.uk> libwww-robotrules-perl (6.01-1) unstable; urgency=low * Initial Release (Closes: #618281).

    Advertisement
    Advertisement