ℹ️ Skipped - page is already crawled
| Filter | Status | Condition | Details |
|---|---|---|---|
| HTTP status | PASS | download_http_code = 200 | HTTP 200 |
| Age cutoff | PASS | download_stamp > now() - 6 MONTH | 1 months ago |
| History drop | PASS | isNull(history_drop_reason) | No drop reason |
| Spam/ban | PASS | fh_dont_index != 1 AND ml_spam_score = 0 | ml_spam_score=0 |
| Canonical | PASS | meta_canonical IS NULL OR = '' OR = src_unparsed | Not set |
| Property | Value | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| URL | https://murphypei.github.io/blog/2020/09/pytorch-distributed | |||||||||
| Last Crawled | 2026-05-03 03:24:51 (1 month ago) | |||||||||
| First Indexed | 2020-09-26 07:35:34 (5 years ago) | |||||||||
| HTTP Status Code | 200 | |||||||||
| Content | ||||||||||
| Meta Title | PyTorch 多进程分布式训练实战 | 拾荒志 | |||||||||
| Meta Description | PyTorch 可以通过 torch.nn.DataParallel 直接切分数据并行在单机多卡上，实践证明这个接口并行力度并不尽如人意，主要问题在于数据在 master 上处理然后下发到其他 slaver 上训练，而且由于 GIL 的存在只有计算是并行的。torch.distributed 提供了更好的接口和并行方式，搭配多进程接口 torch.multiprocessing 可以提供更加高效的 | |||||||||
| Meta Canonical | null | |||||||||
| Boilerpipe Text | heavy column, fetched on demand | |||||||||
| Markdown | heavy column, fetched on demand | |||||||||
| Readable Markdown | heavy column, fetched on demand | |||||||||
| ML Classification | ||||||||||
| ML Categories |
Raw JSON{
"/Computers_and_Electronics": 980,
"/Computers_and_Electronics/Programming": 491,
"/Computers_and_Electronics/Programming/Development_Tools": 277
} | |||||||||
| ML Page Types |
Raw JSON{
"/Article": 999,
"/Article/Tutorial_or_Guide": 987
} | |||||||||
| ML Intent Types |
Raw JSON{
"Informational": 999
} | |||||||||
| Content Metadata | ||||||||||
| Language | zh-cn | |||||||||
| Author | null | |||||||||
| Publish Time | 2020-09-24 08:02:34 (5 years ago) | |||||||||
| Original Publish Time | 2020-09-01 00:00:00 (5 years ago) | |||||||||
| Republished | No | |||||||||
| Word Count (Total) | 786 | |||||||||
| Word Count (Content) | 635 | |||||||||
| Links | ||||||||||
| External Links | 5 | |||||||||
| Internal Links | 20 | |||||||||
| Technical SEO | ||||||||||
| Meta Nofollow | No | |||||||||
| Meta Noarchive | No | |||||||||
| JS Rendered | Yes | |||||||||
| Redirect Target | null | |||||||||
| Performance | ||||||||||
| Download Time (ms) | 41 | |||||||||
| TTFB (ms) | 40 | |||||||||
| Download Size (bytes) | 12,013 | |||||||||
| Location | ||||||||||
| Host ID | 143 (laksa143) | |||||||||
| Partition ID | 61 | |||||||||
| Root Hash | 2566890010099092343 | |||||||||
| Unparsed URL | io,github!murphypei,/blog/2020/09/pytorch-distributed s443 | |||||||||