🕷️ Crawler Inspector

URL Lookup

Direct Parameter Lookup

Raw Queries and Responses

1. Shard Calculation

Query:

Response:

Calculated Shard: 102 (from laksa180)

2. Crawled Status Check

Query:

curl -X POST \
  'http://laksa102.int.ahrefs:8124/' \
  -H 'Content-Type: text/plain' \
  -H 'X-ClickHouse-Database: crawler3' \
  -H 'Authorization: Basic YXBpOg==' \
  -d 'SELECT getAhrefsURLFromUnparsed(src_unparsed) AS found_url, ifNull(toUnixTimestamp(download_stamp), 0) AS crawl_time, ifNull(toUnixTimestamp(props_url_first_seen), 0) AS first_indexed_time, download_http_code AS http_code, src_unparsed AS src_unparsed, src_root_hash AS src_root_hash, history_drop_reason AS history_drop_reason, meta_title AS meta_title, meta_descriptions AS meta_descriptions, attrs_boilerpipe_text AS attrs_boilerpipe_text, attrs_markdown AS attrs_markdown, attrs_readable_markdown AS attrs_readable_markdown, meta_canonical AS meta_canonical FROM crawler3.page_info_local FINAL PREWHERE (src_root_hash, src_unparsed) IN ((getAhrefsRootHashFromUnparsed(getAhrefsUnparsedNoserviceFromURL(\'https://cyber.harvard.edu/copyrightforlibrarians/Berne_Convention\')), getAhrefsUnparsedNoserviceFromURL(\'https://cyber.harvard.edu/copyrightforlibrarians/Berne_Convention\'))) FORMAT JSONEachRow'

Response:

{"found_url":"https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Berne_Convention","crawl_time":1769427098,"first_indexed_time":0,"http_code":200,"src_unparsed":"edu,harvard!cyber,\/copyrightforlibrarians\/Berne_Convention s443","src_root_hash":"2971912334127662702","history_drop_reason":null,"meta_title":"Berne Convention - Copyright for Librarians","meta_descriptions":[],"attrs_boilerpipe_text":"The uncertainty and confusion that generated the lack of a unified framework for the protection of copyright led 10 European States in 1886 to sign the Berne Convention for the Protection of Literary and Artistic Works (Berne Convention). Among the first members of the convention were the primary colonial powers of that time.  As a result, the Berne Convention immediately extended to a significant part of the world.\nAfter its conclusion in 1886, the Berne Convention was revised at Paris in 1896 and at Berlin in 1908, completed at Berne in 1914, revised at Rome in 1928, at Brussels in 1948, at Stockholm in 1967 and at Paris in 1971, and was amended in 1979.\nThe Berne Convention set up a bureau to handle administrative tasks. In 1893, it became the\nUnited International Bureaux for the Protection of Intellectual Property\n(best known by its French acronym BIRPI), situated in Berne. In 1960, BIRPI moved to\nGeneva\n, to be closer to the\nUnited Nations\nand other international organizations in that city. In 1967, it became the\nWorld Intellectual Property Organization (WIPO)\n, and in 1974 became an organization within the\nUnited Nations\n.\nAlthough only 10 countries signed the Berne Convention in 1886, today 164 countries are members of the Berne Convention. The Convention is open to all States, which means that accession occurs by the direct participation of the new member state in the treaty, without any modification of the original agreement. You can check if your country is a member of the Berne Convention on the\nWorld Intellectual Property Organization\nsite.\nAs described below, the content of the Berne Convention was heavily shaped by the civil-law version of copyright law. For example, the protection of non-economic moral rights of authors as well as the lack of a general requirement for registration of copyright works were rules that contrasted with the\nAnglo-Saxon\nconcept of \"copyright\". For these reasons, among others, the U.S.A. did not join the Berne Convention for over 100 years.\nThe Convention requires that copyright protection be extended to “every production in the literary, scientific and artistic domain, whatever may be the mode or form of its expression” (Article 2(1)).","attrs_markdown":"# Berne Convention\nFrom Copyright for Librarians\n\n[Jump to navigation](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Berne_Convention#mw-head) [Jump to search](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Berne_Convention#searchInput)\n\nThe uncertainty and confusion that generated the lack of a unified framework for the protection of copyright led 10 European States in 1886 to sign the Berne Convention for the Protection of Literary and Artistic Works (Berne Convention). Among the first members of the convention were the primary colonial powers of that time. As a result, the Berne Convention immediately extended to a significant part of the world.\n\nAfter its conclusion in 1886, the Berne Convention was revised at Paris in 1896 and at Berlin in 1908, completed at Berne in 1914, revised at Rome in 1928, at Brussels in 1948, at Stockholm in 1967 and at Paris in 1971, and was amended in 1979.\n\nThe Berne Convention set up a bureau to handle administrative tasks. In 1893, it became the [United International Bureaux for the Protection of Intellectual Property](http:\/\/en.wikipedia.org\/wiki\/United_International_Bureaux_for_the_Protection_of_Intellectual_Property) (best known by its French acronym BIRPI), situated in Berne. In 1960, BIRPI moved to [Geneva](http:\/\/en.wikipedia.org\/wiki\/Geneva), to be closer to the [United Nations](http:\/\/en.wikipedia.org\/wiki\/United_Nations) and other international organizations in that city. In 1967, it became the [World Intellectual Property Organization (WIPO)](http:\/\/en.wikipedia.org\/wiki\/World_Intellectual_Property_Organization), and in 1974 became an organization within the [United Nations](http:\/\/en.wikipedia.org\/wiki\/United_Nations).\n\nAlthough only 10 countries signed the Berne Convention in 1886, today 164 countries are members of the Berne Convention. The Convention is open to all States, which means that accession occurs by the direct participation of the new member state in the treaty, without any modification of the original agreement. You can check if your country is a member of the Berne Convention on the [World Intellectual Property Organization](http:\/\/www.wipo.int\/treaties\/en\/ShowResults.jsp?lang=en&treaty_id=15) site.\n\nAs described below, the content of the Berne Convention was heavily shaped by the civil-law version of copyright law. For example, the protection of non-economic moral rights of authors as well as the lack of a general requirement for registration of copyright works were rules that contrasted with the [Anglo-Saxon](http:\/\/en.wikipedia.org\/wiki\/Common_law) concept of \"copyright\". For these reasons, among others, the U.S.A. did not join the Berne Convention for over 100 years.\n\nThe Convention requires that copyright protection be extended to “every production in the literary, scientific and artistic domain, whatever may be the mode or form of its expression” (Article 2(1)).\n\nRetrieved from \"<http:\/\/cyber.harvard.edu\/copyrightforlibrarians\/?title=Berne_Convention&oldid=3719>\"\n\n## Navigation menu\n### Personal tools\n- [Log in](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/?title=Special:UserLogin&returnto=Berne+Convention \"You are encouraged to log in; however, it is not mandatory [alt-o]\")\n\n### Namespaces\n- [Page](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Berne_Convention \"View the content page [alt-c]\")\n- [Discussion](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/edit\/Talk:Berne_Convention?redlink=1 \"Discussion about the content page (page does not exist) [alt-t]\")\n\nEnglish\n\n### Views\n- [Read](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Berne_Convention)\n- [View source](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/edit\/Berne_Convention \"This page is protected.\n  You can view its source [alt-e]\")\n- [View history](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/history\/Berne_Convention \"Past revisions of this page [alt-h]\")\n\nMore\n\n### Search\n\n### Navigation\n- [Main page](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Main_Page \"Visit the main page [alt-z]\")\n- [Recent changes](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Special:RecentChanges \"A list of recent changes in the wiki [alt-r]\")\n- [Random page](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Special:Random \"Load a random page [alt-x]\")\n- [Help about MediaWiki](https:\/\/www.mediawiki.org\/wiki\/Special:MyLanguage\/Help:Contents)\n\n### Tools\n- [What links here](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Special:WhatLinksHere\/Berne_Convention \"A list of all wiki pages that link here [alt-j]\")\n- [Related changes](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Special:RecentChangesLinked\/Berne_Convention \"Recent changes in pages linked from this page [alt-k]\")\n- [Special pages](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Special:SpecialPages \"A list of all special pages [alt-q]\")\n- [Printable version](\"Printable version of this page [alt-p]\")\n- [Permanent link](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/?title=Berne_Convention&oldid=3719 \"Permanent link to this revision of this page\")\n- [Page information](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/info\/Berne_Convention \"More information about this page\")\n\n- This page was last edited on 10 March 2010, at 20:40.\n\n- [Privacy policy](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Copyright_for_Librarians:Privacy_policy)\n- [About Copyright for Librarians](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Copyright_for_Librarians:About)\n- [Disclaimers](https:\/\/cyber.harvard.edu\/copyrightforlibrarians\/Copyright_for_Librarians:General_disclaimer)","attrs_readable_markdown":null,"meta_canonical":null}

3. Robots.txt Check

Query:

Response:

4. Spam/Ban Check

Query:

Response:

5. Seen Status Check

ℹ️ Skipped - page is already crawled

📄

INDEXABLE

✅

CRAWLED

2 months ago

🤖

ROBOTS ALLOWED

Page Info Filters

Filter	Status	Condition	Details
HTTP status	PASS	`download_http_code = 200`	HTTP 200
Age cutoff	PASS	`download_stamp > now() - 6 MONTH`	2.5 months ago
History drop	PASS	`isNull(history_drop_reason)`	No drop reason
Spam/ban	PASS	`fh_dont_index != 1 AND ml_spam_score = 0`	ml_spam_score=0
Canonical	PASS	`meta_canonical IS NULL OR = '' OR = src_unparsed`	Not set

Page Details

Property	Value
URL	https://cyber.harvard.edu/copyrightforlibrarians/Berne_Convention
Last Crawled	2026-01-26 11:31:38 (2 months ago)
First Indexed	not set
HTTP Status Code	200
Meta Title	Berne Convention - Copyright for Librarians
Meta Description	null
Meta Canonical	null
Boilerpipe Text	The uncertainty and confusion that generated the lack of a unified framework for the protection of copyright led 10 European States in 1886 to sign the Berne Convention for the Protection of Literary and Artistic Works (Berne Convention). Among the first members of the convention were the primary colonial powers of that time. As a result, the Berne Convention immediately extended to a significant part of the world. After its conclusion in 1886, the Berne Convention was revised at Paris in 1896 and at Berlin in 1908, completed at Berne in 1914, revised at Rome in 1928, at Brussels in 1948, at Stockholm in 1967 and at Paris in 1971, and was amended in 1979. The Berne Convention set up a bureau to handle administrative tasks. In 1893, it became the United International Bureaux for the Protection of Intellectual Property (best known by its French acronym BIRPI), situated in Berne. In 1960, BIRPI moved to Geneva , to be closer to the United Nations and other international organizations in that city. In 1967, it became the World Intellectual Property Organization (WIPO) , and in 1974 became an organization within the United Nations . Although only 10 countries signed the Berne Convention in 1886, today 164 countries are members of the Berne Convention. The Convention is open to all States, which means that accession occurs by the direct participation of the new member state in the treaty, without any modification of the original agreement. You can check if your country is a member of the Berne Convention on the World Intellectual Property Organization site. As described below, the content of the Berne Convention was heavily shaped by the civil-law version of copyright law. For example, the protection of non-economic moral rights of authors as well as the lack of a general requirement for registration of copyright works were rules that contrasted with the Anglo-Saxon concept of "copyright". For these reasons, among others, the U.S.A. did not join the Berne Convention for over 100 years. The Convention requires that copyright protection be extended to “every production in the literary, scientific and artistic domain, whatever may be the mode or form of its expression” (Article 2(1)).
Markdown	# Berne Convention From Copyright for Librarians [Jump to navigation](https://cyber.harvard.edu/copyrightforlibrarians/Berne_Convention#mw-head) [Jump to search](https://cyber.harvard.edu/copyrightforlibrarians/Berne_Convention#searchInput) The uncertainty and confusion that generated the lack of a unified framework for the protection of copyright led 10 European States in 1886 to sign the Berne Convention for the Protection of Literary and Artistic Works (Berne Convention). Among the first members of the convention were the primary colonial powers of that time. As a result, the Berne Convention immediately extended to a significant part of the world. After its conclusion in 1886, the Berne Convention was revised at Paris in 1896 and at Berlin in 1908, completed at Berne in 1914, revised at Rome in 1928, at Brussels in 1948, at Stockholm in 1967 and at Paris in 1971, and was amended in 1979. The Berne Convention set up a bureau to handle administrative tasks. In 1893, it became the [United International Bureaux for the Protection of Intellectual Property](http://en.wikipedia.org/wiki/United_International_Bureaux_for_the_Protection_of_Intellectual_Property) (best known by its French acronym BIRPI), situated in Berne. In 1960, BIRPI moved to [Geneva](http://en.wikipedia.org/wiki/Geneva), to be closer to the [United Nations](http://en.wikipedia.org/wiki/United_Nations) and other international organizations in that city. In 1967, it became the [World Intellectual Property Organization (WIPO)](http://en.wikipedia.org/wiki/World_Intellectual_Property_Organization), and in 1974 became an organization within the [United Nations](http://en.wikipedia.org/wiki/United_Nations). Although only 10 countries signed the Berne Convention in 1886, today 164 countries are members of the Berne Convention. The Convention is open to all States, which means that accession occurs by the direct participation of the new member state in the treaty, without any modification of the original agreement. You can check if your country is a member of the Berne Convention on the [World Intellectual Property Organization](http://www.wipo.int/treaties/en/ShowResults.jsp?lang=en&treaty_id=15) site. As described below, the content of the Berne Convention was heavily shaped by the civil-law version of copyright law. For example, the protection of non-economic moral rights of authors as well as the lack of a general requirement for registration of copyright works were rules that contrasted with the [Anglo-Saxon](http://en.wikipedia.org/wiki/Common_law) concept of "copyright". For these reasons, among others, the U.S.A. did not join the Berne Convention for over 100 years. The Convention requires that copyright protection be extended to “every production in the literary, scientific and artistic domain, whatever may be the mode or form of its expression” (Article 2(1)). Retrieved from "<http://cyber.harvard.edu/copyrightforlibrarians/?title=Berne_Convention&oldid=3719>" ## Navigation menu ### Personal tools - [Log in](https://cyber.harvard.edu/copyrightforlibrarians/?title=Special:UserLogin&returnto=Berne+Convention "You are encouraged to log in; however, it is not mandatory [alt-o]") ### Namespaces - [Page](https://cyber.harvard.edu/copyrightforlibrarians/Berne_Convention "View the content page [alt-c]") - [Discussion](https://cyber.harvard.edu/copyrightforlibrarians/edit/Talk:Berne_Convention?redlink=1 "Discussion about the content page (page does not exist) [alt-t]") English ### Views - [Read](https://cyber.harvard.edu/copyrightforlibrarians/Berne_Convention) - [View source](https://cyber.harvard.edu/copyrightforlibrarians/edit/Berne_Convention "This page is protected. You can view its source [alt-e]") - [View history](https://cyber.harvard.edu/copyrightforlibrarians/history/Berne_Convention "Past revisions of this page [alt-h]") More ### Search ### Navigation - [Main page](https://cyber.harvard.edu/copyrightforlibrarians/Main_Page "Visit the main page [alt-z]") - [Recent changes](https://cyber.harvard.edu/copyrightforlibrarians/Special:RecentChanges "A list of recent changes in the wiki [alt-r]") - [Random page](https://cyber.harvard.edu/copyrightforlibrarians/Special:Random "Load a random page [alt-x]") - [Help about MediaWiki](https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents) ### Tools - [What links here](https://cyber.harvard.edu/copyrightforlibrarians/Special:WhatLinksHere/Berne_Convention "A list of all wiki pages that link here [alt-j]") - [Related changes](https://cyber.harvard.edu/copyrightforlibrarians/Special:RecentChangesLinked/Berne_Convention "Recent changes in pages linked from this page [alt-k]") - [Special pages](https://cyber.harvard.edu/copyrightforlibrarians/Special:SpecialPages "A list of all special pages [alt-q]") - [Printable version]("Printable version of this page [alt-p]") - [Permanent link](https://cyber.harvard.edu/copyrightforlibrarians/?title=Berne_Convention&oldid=3719 "Permanent link to this revision of this page") - [Page information](https://cyber.harvard.edu/copyrightforlibrarians/info/Berne_Convention "More information about this page") - This page was last edited on 10 March 2010, at 20:40. - [Privacy policy](https://cyber.harvard.edu/copyrightforlibrarians/Copyright_for_Librarians:Privacy_policy) - [About Copyright for Librarians](https://cyber.harvard.edu/copyrightforlibrarians/Copyright_for_Librarians:About) - [Disclaimers](https://cyber.harvard.edu/copyrightforlibrarians/Copyright_for_Librarians:General_disclaimer)
Readable Markdown	null
Shard	102 (laksa)
Root Hash	2971912334127662702
Unparsed URL	edu,harvard!cyber,/copyrightforlibrarians/Berne_Convention s443