Wanglixia
/
java
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
40 Commits
1 Branch
0 Tags
26 MiB
 
Tree: ac748c59da
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'ac748c59da'
${ noResults }
java/project/spider/logs/spider-crawl-2026-05-31.0.log

1828 lines
191 KiB
Raw Blame History

2026-05-31 17:59:10.612 [main] INFO com.spider.service.DataStorageService - 创建数据目录: data
2026-05-31 17:59:10.613 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 17:59:10.615 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 17:59:11.694 [main] INFO com.spider.service.DoubanBookSpider - 第 1 页没有更多书籍
2026-05-31 17:59:11.695 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 0 本书
2026-05-31 17:59:11.695 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 17:59:11.697 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 17:59:11.699 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 17:59:12.173 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 17:59:12.358 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 17:59:12.474 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 17:59:12.661 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 17:59:12.769 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 17:59:12.864 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 17:59:12.973 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 8 页 (176): https://movie.douban.com/top250?start=175
2026-05-31 17:59:13.089 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 9 页 (201): https://movie.douban.com/top250?start=200
2026-05-31 17:59:13.188 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 10 页 (226): https://movie.douban.com/top250?start=225
2026-05-31 17:59:13.283 [main] INFO com.spider.service.DoubanMovieSpider - 豆瓣电影爬取完成，共获取 250 部电影
2026-05-31 17:59:13.433 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_175913.json
2026-05-31 17:59:13.433 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 17:59:13.433 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 17:59:13.911 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 17:59:13.916 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_175913.json
2026-05-31 17:59:13.916 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 17:59:13.918 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_175913.json
2026-05-31 17:59:13.919 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_175913.json
2026-05-31 18:06:37.844 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:06:37.844 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:06:39.098 [main] INFO com.spider.service.DoubanBookSpider - 第 1 页找到 6 个书籍元素
2026-05-31 18:06:39.106 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 2 页: https://book.douban.com/chart?sub_type=1&page=2
2026-05-31 18:06:39.331 [main] INFO com.spider.service.DoubanBookSpider - 第 2 页找到 6 个书籍元素
2026-05-31 18:06:39.341 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 3 页: https://book.douban.com/chart?sub_type=1&page=3
2026-05-31 18:06:39.536 [main] INFO com.spider.service.DoubanBookSpider - 第 3 页找到 6 个书籍元素
2026-05-31 18:06:39.541 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 4 页: https://book.douban.com/chart?sub_type=1&page=4
2026-05-31 18:06:39.746 [main] INFO com.spider.service.DoubanBookSpider - 第 4 页找到 6 个书籍元素
2026-05-31 18:06:39.748 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 5 页: https://book.douban.com/chart?sub_type=1&page=5
2026-05-31 18:06:39.945 [main] INFO com.spider.service.DoubanBookSpider - 第 5 页找到 6 个书籍元素
2026-05-31 18:06:39.947 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 6 页: https://book.douban.com/chart?sub_type=1&page=6
2026-05-31 18:06:40.149 [main] INFO com.spider.service.DoubanBookSpider - 第 6 页找到 6 个书籍元素
2026-05-31 18:06:40.150 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 7 页: https://book.douban.com/chart?sub_type=1&page=7
2026-05-31 18:06:40.351 [main] INFO com.spider.service.DoubanBookSpider - 第 7 页找到 6 个书籍元素
2026-05-31 18:06:40.352 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 8 页: https://book.douban.com/chart?sub_type=1&page=8
2026-05-31 18:06:40.557 [main] INFO com.spider.service.DoubanBookSpider - 第 8 页找到 6 个书籍元素
2026-05-31 18:06:40.558 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 9 页: https://book.douban.com/chart?sub_type=1&page=9
2026-05-31 18:06:40.762 [main] INFO com.spider.service.DoubanBookSpider - 第 9 页找到 6 个书籍元素
2026-05-31 18:06:40.763 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 10 页: https://book.douban.com/chart?sub_type=1&page=10
2026-05-31 18:06:40.964 [main] INFO com.spider.service.DoubanBookSpider - 第 10 页找到 6 个书籍元素
2026-05-31 18:06:40.965 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 40 本书
2026-05-31 18:06:41.007 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_180640.json
2026-05-31 18:06:41.007 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:06:41.007 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:06:41.492 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 18:06:41.596 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 18:06:41.705 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 18:06:41.889 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 18:06:41.995 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 18:06:42.093 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 18:06:42.202 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 8 页 (176): https://movie.douban.com/top250?start=175
2026-05-31 18:06:42.397 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 9 页 (201): https://movie.douban.com/top250?start=200
2026-05-31 18:06:42.512 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 10 页 (226): https://movie.douban.com/top250?start=225
2026-05-31 18:06:42.615 [main] INFO com.spider.service.DoubanMovieSpider - 豆瓣电影爬取完成，共获取 250 部电影
2026-05-31 18:06:42.735 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_180642.json
2026-05-31 18:06:42.736 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:06:42.736 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:06:43.330 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:06:43.339 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_180643.json
2026-05-31 18:06:43.342 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_180643.json
2026-05-31 18:06:43.344 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_180643.json
2026-05-31 18:06:43.346 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_180643.json
2026-05-31 18:10:11.199 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:10:11.200 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:10:12.117 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 2 页: https://book.douban.com/chart?sub_type=1&page=2
2026-05-31 18:10:12.338 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 50 本书
2026-05-31 18:10:12.381 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_181012.json
2026-05-31 18:10:12.381 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:10:12.381 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:10:12.854 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 18:10:13.043 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 18:10:13.148 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 18:10:13.258 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 18:10:13.446 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 18:10:13.549 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 18:10:13.654 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 8 页 (176): https://movie.douban.com/top250?start=175
2026-05-31 18:10:13.856 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 9 页 (201): https://movie.douban.com/top250?start=200
2026-05-31 18:10:13.958 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 10 页 (226): https://movie.douban.com/top250?start=225
2026-05-31 18:10:14.075 [main] INFO com.spider.service.DoubanMovieSpider - 豆瓣电影爬取完成，共获取 250 部电影
2026-05-31 18:10:14.196 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_181014.json
2026-05-31 18:10:14.196 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:10:14.196 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:10:14.705 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:10:14.711 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_181014.json
2026-05-31 18:10:14.713 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_181014.json
2026-05-31 18:10:14.715 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_181014.json
2026-05-31 18:10:14.718 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_181014.json
2026-05-31 18:11:36.812 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:11:36.813 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:11:37.685 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:11:37.696 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 2 页: https://book.douban.com/chart?sub_type=1&page=2
2026-05-31 18:11:37.958 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:11:37.959 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 50 本书
2026-05-31 18:11:38.013 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_181137.json
2026-05-31 18:11:38.013 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:11:38.013 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:11:38.566 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 18:11:38.673 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 18:11:38.765 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 18:11:38.954 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 18:11:39.155 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 18:11:39.260 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 18:11:39.464 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 8 页 (176): https://movie.douban.com/top250?start=175
2026-05-31 18:11:39.568 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 9 页 (201): https://movie.douban.com/top250?start=200
2026-05-31 18:11:39.674 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 10 页 (226): https://movie.douban.com/top250?start=225
2026-05-31 18:11:39.793 [main] INFO com.spider.service.DoubanMovieSpider - 豆瓣电影爬取完成，共获取 250 部电影
2026-05-31 18:11:39.900 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_181139.json
2026-05-31 18:11:39.901 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:11:39.901 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:11:40.201 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:11:40.206 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_181140.json
2026-05-31 18:11:40.208 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_181140.json
2026-05-31 18:11:40.209 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_181140.json
2026-05-31 18:11:40.211 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_181140.json
2026-05-31 18:13:36.332 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:13:36.332 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:13:37.500 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:13:37.513 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 2 页: https://book.douban.com/chart?sub_type=1&page=2
2026-05-31 18:13:37.739 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:13:37.740 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 50 本书
2026-05-31 18:13:37.785 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_181337.json
2026-05-31 18:13:37.786 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:13:37.786 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:13:38.266 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 18:13:38.482 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 18:13:38.663 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 18:13:38.779 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 18:13:38.964 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 18:13:39.070 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 18:13:39.275 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 8 页 (176): https://movie.douban.com/top250?start=175
2026-05-31 18:13:39.378 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 9 页 (201): https://movie.douban.com/top250?start=200
2026-05-31 18:13:39.483 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 10 页 (226): https://movie.douban.com/top250?start=225
2026-05-31 18:13:39.599 [main] INFO com.spider.service.DoubanMovieSpider - 豆瓣电影爬取完成，共获取 250 部电影
2026-05-31 18:13:39.712 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_181339.json
2026-05-31 18:13:39.712 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:13:39.712 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:13:40.224 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:13:40.229 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_181340.json
2026-05-31 18:13:40.232 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_181340.json
2026-05-31 18:13:40.234 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_181340.json
2026-05-31 18:13:40.234 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_181340.json
2026-05-31 18:15:15.754 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:15:15.754 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:15:16.729 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:15:16.745 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 2 页: https://book.douban.com/chart?sub_type=1&page=2
2026-05-31 18:15:16.970 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:15:16.974 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 50 本书
2026-05-31 18:15:17.023 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_181516.json
2026-05-31 18:15:17.024 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:15:17.024 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:15:17.599 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 18:15:17.803 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 18:15:17.906 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 18:15:18.008 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 18:15:18.191 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 18:15:18.306 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 18:15:18.405 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 8 页 (176): https://movie.douban.com/top250?start=175
2026-05-31 18:15:18.524 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 9 页 (201): https://movie.douban.com/top250?start=200
2026-05-31 18:15:18.616 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 10 页 (226): https://movie.douban.com/top250?start=225
2026-05-31 18:15:18.728 [main] INFO com.spider.service.DoubanMovieSpider - 豆瓣电影爬取完成，共获取 250 部电影
2026-05-31 18:15:18.853 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_181518.json
2026-05-31 18:15:18.854 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:15:18.854 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:15:19.423 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:15:19.427 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_181519.json
2026-05-31 18:15:19.431 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books_20260531_181519.json
2026-05-31 18:15:19.432 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies_20260531_181519.json
2026-05-31 18:15:19.434 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_20260531_181519.json
2026-05-31 18:23:56.176 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:23:56.177 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:23:57.144 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:23:57.158 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 2 页: https://book.douban.com/chart?sub_type=1&page=2
2026-05-31 18:23:57.364 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:23:57.367 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 50 本书
2026-05-31 18:23:57.384 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books.csv
2026-05-31 18:23:57.385 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:23:57.385 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:23:57.886 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 18:23:57.982 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 18:23:58.087 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 18:23:58.205 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 18:23:58.387 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 18:23:58.487 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 18:23:58.599 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 8 页 (176): https://movie.douban.com/top250?start=175
2026-05-31 18:23:58.711 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 9 页 (201): https://movie.douban.com/top250?start=200
2026-05-31 18:23:58.823 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 10 页 (226): https://movie.douban.com/top250?start=225
2026-05-31 18:23:59.309 [main] INFO com.spider.service.DoubanMovieSpider - 豆瓣电影爬取完成，共获取 250 部电影
2026-05-31 18:23:59.410 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies.csv
2026-05-31 18:23:59.410 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:23:59.410 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:24:00.027 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:24:00.034 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 18:24:00.035 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books.csv
2026-05-31 18:24:00.036 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies.csv
2026-05-31 18:24:00.037 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 18:33:53.627 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:33:53.628 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:33:54.515 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:33:54.529 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 2 页: https://book.douban.com/chart?sub_type=1&page=2
2026-05-31 18:33:54.772 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:33:54.776 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 50 本书
2026-05-31 18:33:54.803 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books.csv
2026-05-31 18:33:54.803 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:33:54.803 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:33:55.308 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 18:33:55.492 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 18:33:55.587 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 18:33:55.692 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 18:33:55.800 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 18:33:55.895 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 18:33:55.996 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 8 页 (176): https://movie.douban.com/top250?start=175
2026-05-31 18:33:56.201 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 9 页 (201): https://movie.douban.com/top250?start=200
2026-05-31 18:33:56.315 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 10 页 (226): https://movie.douban.com/top250?start=225
2026-05-31 18:33:56.414 [main] INFO com.spider.service.DoubanMovieSpider - 豆瓣电影爬取完成，共获取 250 部电影
2026-05-31 18:33:56.524 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies.csv
2026-05-31 18:33:56.524 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:33:56.524 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:33:57.048 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:33:57.052 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 18:33:57.054 [main] INFO com.spider.service.DataStorageService - 书籍数据已保存到: data\books.csv
2026-05-31 18:33:57.055 [main] INFO com.spider.service.DataStorageService - 电影数据已保存到: data\movies.csv
2026-05-31 18:33:57.056 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 18:41:42.563 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:41:42.564 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:41:43.409 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:41:43.424 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 2 页: https://book.douban.com/chart?sub_type=1&page=2
2026-05-31 18:41:43.661 [main] INFO com.spider.service.DoubanBookSpider - 找到 40 个 h2 标签
2026-05-31 18:41:43.664 [main] INFO com.spider.service.DoubanBookSpider - 豆瓣读书爬取完成，共获取 50 本书
2026-05-31 18:41:43.730 [main] ERROR com.spider.service.DataStorageService - 保存书籍数据失败
java.io.FileNotFoundException: data\books.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveBooksToCsv(DataStorageService.java:94)
at com.spider.service.DataStorageService.saveBooks(DataStorageService.java:50)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:69)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:41:43.731 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:41:43.731 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:41:47.241 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1295644/ - URL: https://movie.douban.com/subject/1295644/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1295644%2F&_s=19d90a80e685c89f498db6303ac9746a0788c6f75e9dbf5242c3f8e79e183ba7&a=1'
2026-05-31 18:41:48.571 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3541415/ - URL: https://movie.douban.com/subject/3541415/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3541415%2F&_s=b60726b8b232a58ecb4ab80744cfadd91f86df8d2daf6dfb69b1cc1b3c2ec607&a=1'
2026-05-31 18:41:49.902 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292064/ - URL: https://movie.douban.com/subject/1292064/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292064%2F&_s=582c0f41bcd8420b61faf56b4ca7b43d2522eff4b15c3cb6893ccb5131275d0b&a=1'
2026-05-31 18:41:51.234 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1295124/ - URL: https://movie.douban.com/subject/1295124/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1295124%2F&_s=8f76223bf35fa0e09a6dec62972e26694f129d02910b2dad1a5f6cfb4cfdd5b7&a=1'
2026-05-31 18:41:52.564 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3011091/ - URL: https://movie.douban.com/subject/3011091/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3011091%2F&_s=a0c05d1c2ea0142b57c7ded279a9027e49e7ed0aaaca4fc88d182da496ca0c5e&a=1'
2026-05-31 18:41:53.896 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292001/ - URL: https://movie.douban.com/subject/1292001/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292001%2F&_s=42d9d2b1a4de3deedd90f3f7f2fce0668bdb697df72509ff681737a4175eae05&a=1'
2026-05-31 18:41:55.151 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/25662329/ - URL: https://movie.douban.com/subject/25662329/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F25662329%2F&_s=f9eeeab9834d75c0712e5820644f3596a69313df1dcd8b67f294b58e72f2db10&a=1'
2026-05-31 18:41:56.381 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3793023/ - URL: https://movie.douban.com/subject/3793023/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3793023%2F&_s=f134521f56d8434140d01ce4a5055b4e8b2c3f87eae895fc975de06c55d15224&a=1'
2026-05-31 18:41:57.685 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/2131459/ - URL: https://movie.douban.com/subject/2131459/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F2131459%2F&_s=c1ea117e3b324d3dad6507c8f95ef5ecb8b7870c722771c1217048b1b3f77a64&a=1'
2026-05-31 18:41:59.222 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1307914/ - URL: https://movie.douban.com/subject/1307914/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1307914%2F&_s=49a74dcc367a70937524f8458be6713b314019bbcd1ab12e5e77a3b15f65d01f&a=1'
2026-05-31 18:42:00.478 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1296141/ - URL: https://movie.douban.com/subject/1296141/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1296141%2F&_s=620de006e8c9c894df5e0eed79e902eb614205b27ed75faa53bd6a2aa7e077f6&a=1'
2026-05-31 18:42:01.780 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/20495023/ - URL: https://movie.douban.com/subject/20495023/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F20495023%2F&_s=48ed1e86d7198b4ef9b234b1dc8921e98cd7a5fc716753ed8a98bbc34b577db1&a=1'
2026-05-31 18:42:03.036 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292213/ - URL: https://movie.douban.com/subject/1292213/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292213%2F&_s=309f9fb7afab29756c23f76bcaf21d84a3842138a1691bd7585bc17f7668f552&a=1'
2026-05-31 18:42:04.341 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/5912992/ - URL: https://movie.douban.com/subject/5912992/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F5912992%2F&_s=1dda0f90711eb2b6e159c8d74e29140d36bcc30690e97dc73a4dc743c881077b&a=1'
2026-05-31 18:42:05.674 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/6786002/ - URL: https://movie.douban.com/subject/6786002/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F6786002%2F&_s=370779d74c6d2938d6e31a66cbadf463181b8f58f6988c2407fe85b76e787946&a=1'
2026-05-31 18:42:06.927 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291841/ - URL: https://movie.douban.com/subject/1291841/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291841%2F&_s=09325b64707e27d1e6d971a62653ad6c4d495cf817c05ccea7290ffef1b26e23&a=1'
2026-05-31 18:42:08.233 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1293172/ - URL: https://movie.douban.com/subject/1293172/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1293172%2F&_s=2abf2b3aefdf70afd59ea35cb968f83c1365093a2d5a3b05676de17f8f16b779&a=1'
2026-05-31 18:42:08.234 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 2 页 (26): https://movie.douban.com/top250?start=25
2026-05-31 18:42:09.591 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1295038/ - URL: https://movie.douban.com/subject/1295038/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1295038%2F&_s=5f1072d4328097584500f07e2db94049df527b3e438c5441b9ba2fc421252e55&a=1'
2026-05-31 18:42:11.024 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291560/ - URL: https://movie.douban.com/subject/1291560/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291560%2F&_s=4f101b51a741e0f51c27428b28c456b4ed35e25b2c733f1395ff2ad17f7aa95f&a=1'
2026-05-31 18:42:12.328 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292365/ - URL: https://movie.douban.com/subject/1292365/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292365%2F&_s=e3d8862f74c367362a30d267b1dc0698e215730e568c059a649c47fc8a783d5a&a=1'
2026-05-31 18:42:13.585 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3319755/ - URL: https://movie.douban.com/subject/3319755/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3319755%2F&_s=dd2300fc85e7fdd0f3a16c82d0c61156d72db71f5891d81c56de6c3f704a001c&a=1'
2026-05-31 18:42:14.888 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1851857/ - URL: https://movie.douban.com/subject/1851857/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1851857%2F&_s=48db3f00dad8df4220e5737be12fd4ff7af622ef118811374b1a9a96419c2a68&a=1'
2026-05-31 18:42:16.221 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291552/ - URL: https://movie.douban.com/subject/1291552/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291552%2F&_s=2e26fbb4147403290cfbc8413dd30a586b710620b18d50e35303e18763552dbc&a=1'
2026-05-31 18:42:17.550 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/26752088/ - URL: https://movie.douban.com/subject/26752088/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F26752088%2F&_s=e79d28722ad099e437e7c9fd2707dec8dba2a94750c825086a8ccb4645d4d153&a=1'
2026-05-31 18:42:18.806 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1300267/ - URL: https://movie.douban.com/subject/1300267/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1300267%2F&_s=6a06f703d5f1f2e5470766436f3de62ad396e8c17d6c0093e647adf46628e793&a=1'
2026-05-31 18:42:20.036 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3742360/ - URL: https://movie.douban.com/subject/3742360/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3742360%2F&_s=a1aca855ef0f0b50e5f7ef39bb3aa60651c6da0ae505e0991d61943a3e015083&a=1'
2026-05-31 18:42:21.262 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/2129039/ - URL: https://movie.douban.com/subject/2129039/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F2129039%2F&_s=37608c3df49335e9de26ff38c49fc54c24ef7153a460d209402419217dd22388&a=1'
2026-05-31 18:42:22.775 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1293182/ - URL: https://movie.douban.com/subject/1293182/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1293182%2F&_s=bbc648f97ee7686e12042eeb1480fe53d183e05c31c3bd2910282bff59afb159&a=1'
2026-05-31 18:42:24.028 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/25958717/ - URL: https://movie.douban.com/subject/25958717/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F25958717%2F&_s=0f874c6711daca7375031517db4e90280fb7793b1e603eebae0beb6dab0af469&a=1'
2026-05-31 18:42:25.335 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/21937452/ - URL: https://movie.douban.com/subject/21937452/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F21937452%2F&_s=03adedaa4e2ce28856d86d7ab01910d9abee80a9e20ffa6124cdd00d8ea8cd66&a=1'
2026-05-31 18:42:26.589 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1305487/ - URL: https://movie.douban.com/subject/1305487/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1305487%2F&_s=8c85831d86c594a5d5dcda790e1de8fc25c5c99b82dd724e2540ff8273c27fa8&a=1'
2026-05-31 18:42:27.818 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291583/ - URL: https://movie.douban.com/subject/1291583/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291583%2F&_s=929b6cf35c95c4a00d4ed53adde35d334dad4eea8d48a076ee13a37b16ef4cec&a=1'
2026-05-31 18:42:29.121 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291858/ - URL: https://movie.douban.com/subject/1291858/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291858%2F&_s=9631befd939ea3b6f38d8853c003204abc76bab59f0715ef1a2227e858d2a709&a=1'
2026-05-31 18:42:30.378 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/26387939/ - URL: https://movie.douban.com/subject/26387939/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F26387939%2F&_s=951471a00680b888ff23e0a1a20f23efd3e64ddfeb4bdcc03a2e30cc928fa92d&a=1'
2026-05-31 18:42:31.607 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1929463/ - URL: https://movie.douban.com/subject/1929463/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1929463%2F&_s=33ec4173a700ef035962093d3f6068b206cad375d656b8a6d11829b10e92d7e0&a=1'
2026-05-31 18:42:32.836 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1296736/ - URL: https://movie.douban.com/subject/1296736/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1296736%2F&_s=22aa247702038af9d62e00a1cc16d54eb8c1bcfab207098cda68bd272398b0bf&a=1'
2026-05-31 18:42:34.346 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291572/ - URL: https://movie.douban.com/subject/1291572/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291572%2F&_s=e5d657bffb35b705bc8ea1cb097172487f0722e3a321f58b65baa3c6f1803047&a=1'
2026-05-31 18:42:35.681 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1299398/ - URL: https://movie.douban.com/subject/1299398/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1299398%2F&_s=341d1551f69c2a91355dd4ca436d6a206a4abc8ab563273c43fdbd3d567b474a&a=1'
2026-05-31 18:42:36.931 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/27060077/ - URL: https://movie.douban.com/subject/27060077/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F27060077%2F&_s=875b99a9517af5581577b1e9ca266addfe329675e205b3ccae7a39be96c72169&a=1'
2026-05-31 18:42:36.931 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 3 页 (51): https://movie.douban.com/top250?start=50
2026-05-31 18:42:38.365 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/30170448/ - URL: https://movie.douban.com/subject/30170448/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F30170448%2F&_s=2ded1155ce53575ca1db5b8ae403e3db15c92195f85a5d5ec71df6242d95ccaa&a=1'
2026-05-31 18:42:39.593 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1298624/ - URL: https://movie.douban.com/subject/1298624/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1298624%2F&_s=a7893cf9811df95b3e8070996a8d7c639cf7091a8df6aa8130bc5f79fd87f074&a=1'
2026-05-31 18:42:40.897 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1418019/ - URL: https://movie.douban.com/subject/1418019/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1418019%2F&_s=e5ad11fade978c85c167bc53bb60576e7e73b2b3d3c90c587a7e61af364ff575&a=1'
2026-05-31 18:42:42.230 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291843/ - URL: https://movie.douban.com/subject/1291843/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291843%2F&_s=9676b18e34acbe2202964a7a9e60e5742478be46ce3a0245c0d5a9c7827c8338&a=1'
2026-05-31 18:42:43.559 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291571/ - URL: https://movie.douban.com/subject/1291571/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291571%2F&_s=bbf09d101dfd40540908bf349674f37988406363af93fefd47cc75fcb0d612b4&a=1'
2026-05-31 18:42:44.891 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1293839/ - URL: https://movie.douban.com/subject/1293839/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1293839%2F&_s=7cd9a2d7a8eba30b56a3b4a5c317e5a3f9146d36f052424b8132c3226a25efa9&a=1'
2026-05-31 18:42:46.351 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1301753/ - URL: https://movie.douban.com/subject/1301753/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1301753%2F&_s=a2807203e045af8b93868b6d03bfea08f6625c437d460db0d6f385c9a3fa70a7&a=1'
2026-05-31 18:42:47.655 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291828/ - URL: https://movie.douban.com/subject/1291828/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291828%2F&_s=52a32e937c3bcb2ccd9090941cb52d4eda1ad226f24b748a514d6c52074610c8&a=1'
2026-05-31 18:42:48.988 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291818/ - URL: https://movie.douban.com/subject/1291818/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291818%2F&_s=ea8d527e04948300ed9bd9cc45dab7e6cc39a4c8b449cfae2c22bfc19f32bb92&a=1'
2026-05-31 18:42:50.319 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/21937445/ - URL: https://movie.douban.com/subject/21937445/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F21937445%2F&_s=50a356964b0c7cd6aeec629835872b1dbbee6f333da9d43f521d661d3cc6ee43&a=1'
2026-05-31 18:42:51.649 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1485260/ - URL: https://movie.douban.com/subject/1485260/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1485260%2F&_s=243083c234bf76945e6f0dd5fd74cd364787671f98d2d220fd16868ffb6eaa18&a=1'
2026-05-31 18:42:52.981 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292000/ - URL: https://movie.douban.com/subject/1292000/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292000%2F&_s=8394366bf777277b24c39838e5566a101080093996c689dabc77b13d41011dee&a=1'
2026-05-31 18:42:54.238 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1306029/ - URL: https://movie.douban.com/subject/1306029/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1306029%2F&_s=4dea05bf9cfa44f4866af1ba35cf7044a7a8903cef77f91f4e0b1e2451c441d3&a=1'
2026-05-31 18:42:55.540 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3008247/ - URL: https://movie.douban.com/subject/3008247/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3008247%2F&_s=cd699284dac9d4dbe84e25545b350928290e835fc6ce2cee5f1851114d85c3bb&a=1'
2026-05-31 18:42:56.872 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3011235/ - URL: https://movie.douban.com/subject/3011235/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3011235%2F&_s=621240a666ee2341b2c4906bf39ccba971809a5786f9252a20cdb3c26ac7d8ab&a=1'
2026-05-31 18:42:58.408 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1293350/ - URL: https://movie.douban.com/subject/1293350/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1293350%2F&_s=36f214e8b16e129ae9620e654ecd6d6470bb04b720325a9eb0ae30ba677bd89c&a=1'
2026-05-31 18:42:59.739 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1900841/ - URL: https://movie.douban.com/subject/1900841/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1900841%2F&_s=b70dffa2a1671d3938f1f827944fde1e209a99fa80769812cc0c16483c3c6644&a=1'
2026-05-31 18:43:01.072 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291543/ - URL: https://movie.douban.com/subject/1291543/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291543%2F&_s=a6ffcb7f3432741c0ab7b544ec757f58e6817ec41d5dd6b2490dc5c4af5bc266&a=1'
2026-05-31 18:43:02.327 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1294408/ - URL: https://movie.douban.com/subject/1294408/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1294408%2F&_s=557c8d1fb3030cdbca379210ca72aec0d6b06bd4030f8f3b1201b36404fe61f3&a=1'
2026-05-31 18:43:03.629 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291544/ - URL: https://movie.douban.com/subject/1291544/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291544%2F&_s=c8eed0481b6a5b595648b8f2ed8f6e2031f4f6bd94c9aa992e3975b4d6f59ef1&a=1'
2026-05-31 18:43:04.888 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1652587/ - URL: https://movie.douban.com/subject/1652587/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1652587%2F&_s=b21b94666e7fb556b6fb74f6273c0e47372117057009915a682e4fb33f0642c9&a=1'
2026-05-31 18:43:06.115 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292402/ - URL: https://movie.douban.com/subject/1292402/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292402%2F&_s=c825f34d21ab0f6caf93a1f9672e8965306f330d62f86592b735ae1da91fea0e&a=1'
2026-05-31 18:43:07.422 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/26580232/ - URL: https://movie.douban.com/subject/26580232/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F26580232%2F&_s=37bf7923323b85ff666a7b7db1a85208205073722a5bbc386aa74dacb6c59b20&a=1'
2026-05-31 18:43:07.422 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 4 页 (76): https://movie.douban.com/top250?start=75
2026-05-31 18:43:08.778 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292849/ - URL: https://movie.douban.com/subject/1292849/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292849%2F&_s=32cbb0f3e6b579c6e03f743a2a000377430bc004825b0beb4908403045e87844&a=1'
2026-05-31 18:43:10.082 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1293544/ - URL: https://movie.douban.com/subject/1293544/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1293544%2F&_s=7b5cb6fd77701542835eb326270461c0ff7cfe215eda510286f1a02289714673&a=1'
2026-05-31 18:43:11.543 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292343/ - URL: https://movie.douban.com/subject/1292343/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292343%2F&_s=7d1d2a2de64316458c2471866ddf6ba2e6dfb7764a7a85702a4ce2d508833804&a=1'
2026-05-31 18:43:12.772 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/11525673/ - URL: https://movie.douban.com/subject/11525673/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F11525673%2F&_s=f5165f2567ab0cfdabfd49f8672bbce17250f2663e994bf2bfbd36ec40010626&a=1'
2026-05-31 18:43:14.001 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/36445098/ - URL: https://movie.douban.com/subject/36445098/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F36445098%2F&_s=6b35e3c49fc63ccfd4ecbd67afbe826a9618b5b0c40e885bf90727aceaf9c706&a=1'
2026-05-31 18:43:15.304 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292224/ - URL: https://movie.douban.com/subject/1292224/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292224%2F&_s=859cd9539bab0126ea599aa6e485f194c572953e5c254111e1a3e0605a1af20c&a=1'
2026-05-31 18:43:16.560 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/2334904/ - URL: https://movie.douban.com/subject/2334904/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F2334904%2F&_s=dbede70f0b96caf79fa5cebca4985027d7d3df755bd3b94f6068dbcb0decbc18&a=1'
2026-05-31 18:43:17.862 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292656/ - URL: https://movie.douban.com/subject/1292656/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292656%2F&_s=c46bdf1ae4923596b71132cfaf91ecd83172510c8afb1974ff567d1aa9c8cafa&a=1'
2026-05-31 18:43:19.120 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1780330/ - URL: https://movie.douban.com/subject/1780330/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1780330%2F&_s=9f49ae23f0fa49d2481224f2392edfa85e532f9dda2dda403f8d73587a155328&a=1'
2026-05-31 18:43:20.351 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291832/ - URL: https://movie.douban.com/subject/1291832/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291832%2F&_s=29471ba3628bc2e4b2d3dc3b4badc80866e6aa1bcea81961848d38b4b632e0da&a=1'
2026-05-31 18:43:21.652 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1296996/ - URL: https://movie.douban.com/subject/1296996/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1296996%2F&_s=6f2316a056f1ac5a15d446e67cd10dfe87733f288f3fde5ddd4b474423294dce&a=1'
2026-05-31 18:43:23.115 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292434/ - URL: https://movie.douban.com/subject/1292434/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292434%2F&_s=a154ccfc7e6a1708460dd0f7d53cca0fb62f560d3f3824ef6431cace7de7bae4&a=1'
2026-05-31 18:43:24.342 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1302425/ - URL: https://movie.douban.com/subject/1302425/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1302425%2F&_s=1f65248d3064d0103d7c4cf49d9ba3be166ef92a4a6d5b3437fd03244bdeed58&a=1'
2026-05-31 18:43:25.572 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1300299/ - URL: https://movie.douban.com/subject/1300299/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1300299%2F&_s=ce6056bd1cfbf84fc71d633290ea9ba43c6cfe478dd31cc56371380b269d6b44&a=1'
2026-05-31 18:43:26.876 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1297192/ - URL: https://movie.douban.com/subject/1297192/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1297192%2F&_s=6921c85897845efd2e28fe8b2caafbaaa5169a44333bf303964b1a4bb4778344&a=1'
2026-05-31 18:43:28.211 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1294371/ - URL: https://movie.douban.com/subject/1294371/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1294371%2F&_s=d1c3fbaf78b2fe6a00945a74923ae90a08e509b7de641e60719c08a00419513e&a=1'
2026-05-31 18:43:29.463 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292679/ - URL: https://movie.douban.com/subject/1292679/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292679%2F&_s=c235e527ec9ab37b8ab3f30e48acba48d80cf9a1c7676887c32ab85e3b0c98cd&a=1'
2026-05-31 18:43:30.692 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1298070/ - URL: https://movie.douban.com/subject/1298070/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1298070%2F&_s=ef0275a3474c42a051004b3f0b3dcc1b074e6502d5004defb3dff072068a4f71&a=1'
2026-05-31 18:43:31.996 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3442220/ - URL: https://movie.douban.com/subject/3442220/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3442220%2F&_s=0c113778c4a4cb4f19d31ba901cda8f50ee40924b808b4702817c25018c1013c&a=1'
2026-05-31 18:43:33.328 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292262/ - URL: https://movie.douban.com/subject/1292262/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292262%2F&_s=36bd396dea0cff31fb41630e0344adb41fd0444d8d3e3b246bbd995de9b041dc&a=1'
2026-05-31 18:43:34.862 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292223/ - URL: https://movie.douban.com/subject/1292223/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292223%2F&_s=1151fe87c59895d0df88484fff6e3e3b4f5cef133cd52a517b493399b9ba2487&a=1'
2026-05-31 18:43:36.193 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1306249/ - URL: https://movie.douban.com/subject/1306249/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1306249%2F&_s=1d261e8566a53e176e353b3aa7382a5355bb300894c1b98e8c6211c1150999ae&a=1'
2026-05-31 18:43:36.193 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 5 页 (101): https://movie.douban.com/top250?start=100
2026-05-31 18:43:37.552 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/6985810/ - URL: https://movie.douban.com/subject/6985810/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F6985810%2F&_s=74876346318e93441df416f05fb6980b7442d097670fadbb8ebf4de0cb0a0a50&a=1'
2026-05-31 18:43:38.782 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1297359/ - URL: https://movie.douban.com/subject/1297359/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1297359%2F&_s=310f437abcd0e7003d4f839ab3142c04cdfd92330e8daf5987c1bacbc0494299&a=1'
2026-05-31 18:43:40.011 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/27010768/ - URL: https://movie.douban.com/subject/27010768/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F27010768%2F&_s=09b80065b1c69f9cfbb0858563c8d04028f9bdb5cf5e19e1275c5c8be54ad835&a=1'
2026-05-31 18:43:41.313 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1305164/ - URL: https://movie.douban.com/subject/1305164/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1305164%2F&_s=aa82c2a6cd99a5662a8fd3081e3e29f548efecd08ee60ddb40834a9ce32ebdc3&a=1'
2026-05-31 18:43:42.646 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1428581/ - URL: https://movie.douban.com/subject/1428581/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1428581%2F&_s=2f78991b75ac2abbf326aa4a70fb078f681424fa86124b49737f17eb62975a07&a=1'
2026-05-31 18:43:43.901 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3395373/ - URL: https://movie.douban.com/subject/3395373/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F3395373%2F&_s=9fd928e7604d4f31b6f275c15b847b9bec54551d1ec5a8158d126ac458124c37&a=1'
2026-05-31 18:43:45.131 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/11026735/ - URL: https://movie.douban.com/subject/11026735/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F11026735%2F&_s=5fd1aff37bfeb5f5a31177ee7a0d0b18eee81de1fe6d188a65395aeb9e8a96bf&a=1'
2026-05-31 18:43:46.564 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1461403/ - URL: https://movie.douban.com/subject/1461403/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1461403%2F&_s=063a6bf27b6dbf804a9c874bc11de8981972f28d37723fc3f296ef9acac958f0&a=1'
2026-05-31 18:43:47.791 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1297630/ - URL: https://movie.douban.com/subject/1297630/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1297630%2F&_s=f4bd0265959c2d5bc5ca060e5e47184986e9d0a4a0c18f4bb6f4c15aba383494&a=1'
2026-05-31 18:43:49.096 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1296339/ - URL: https://movie.douban.com/subject/1296339/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1296339%2F&_s=5a00371252e2f52cbd14e3128e970595bd346189f402b0e07a27a907625d62a6&a=1'
2026-05-31 18:43:50.352 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291990/ - URL: https://movie.douban.com/subject/1291990/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291990%2F&_s=a24e3725866b29ec0d44df6bc64c4172fb1f1d5d27f0a20f24ae04c06e164bbc&a=1'
2026-05-31 18:43:51.582 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/10533913/ - URL: https://movie.douban.com/subject/10533913/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F10533913%2F&_s=d2fd748002fd974576cd53c47d689a32e32c4fe3b0268dc50aae615b88a8015d&a=1'
2026-05-31 18:43:52.886 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1787291/ - URL: https://movie.douban.com/subject/1787291/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1787291%2F&_s=6beeaeccfbd330a15e43dad0a34b6afe0db83ec1d4cb15527857485530fae5aa&a=1'
2026-05-31 18:43:54.215 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1309055/ - URL: https://movie.douban.com/subject/1309055/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1309055%2F&_s=b009b9b4b94acca5e91af3bf07fa4b5217f37668053c65d7bcadc52241b4a29a&a=1'
2026-05-31 18:43:55.473 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1395091/ - URL: https://movie.douban.com/subject/1395091/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1395091%2F&_s=88f43f67fe0da3489e08c7931ce1a980092b15dda7e4dc4fdc9a739e60dd0ca7&a=1'
2026-05-31 18:43:56.701 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291999/ - URL: https://movie.douban.com/subject/1291999/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1291999%2F&_s=df6d3ad1072fc6b0e67f017e5d4cc6fa42333149ace310ccf7be0a6844494f31&a=1'
2026-05-31 18:43:57.929 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/4202302/ - URL: https://movie.douban.com/subject/4202302/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F4202302%2F&_s=a2329babeea68ba5749237b37e7f2fb3110573f56e8d8af32efef450d7734e4b&a=1'
2026-05-31 18:43:59.442 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/2149806/ - URL: https://movie.douban.com/subject/2149806/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F2149806%2F&_s=1f0cdbab1edffa827fbbfa7b5850b3c90d870bb03d805a9296e9da4d56ab8ea9&a=1'
2026-05-31 18:44:00.772 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292370/ - URL: https://movie.douban.com/subject/1292370/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1292370%2F&_s=082160fa52606c8c4014f7673d76a04718c8ebe809528a94c29c1487d886d5b1&a=1'
2026-05-31 18:44:02.025 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1418834/ - URL: https://movie.douban.com/subject/1418834/, 网络请求失败: Circular redirect to 'https://sec.douban.com/c?r=https%3A%2F%2Fmovie.douban.com%2Fsubject%2F1418834%2F&_s=71e48b81458a069aedcd1eb1211c9883d5b58f053ccc43f707b6877d493b0a4e&a=1'
2026-05-31 18:44:03.432 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1294639/ - URL: https://movie.douban.com/subject/1294639/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:04.866 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/10577869/ - URL: https://movie.douban.com/subject/10577869/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:06.301 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/2353023/ - URL: https://movie.douban.com/subject/2353023/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:06.301 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 6 页 (126): https://movie.douban.com/top250?start=125
2026-05-31 18:44:07.733 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1418200/ - URL: https://movie.douban.com/subject/1418200/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:09.169 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/21318488/ - URL: https://movie.douban.com/subject/21318488/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:10.806 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1297447/ - URL: https://movie.douban.com/subject/1297447/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:12.271 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/10437779/ - URL: https://movie.douban.com/subject/10437779/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:13.608 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291557/ - URL: https://movie.douban.com/subject/1291557/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:14.987 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1858711/ - URL: https://movie.douban.com/subject/1858711/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:16.301 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/26628357/ - URL: https://movie.douban.com/subject/26628357/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:17.604 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1828115/ - URL: https://movie.douban.com/subject/1828115/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:17.760 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1300992/ - URL: https://movie.douban.com/subject/1300992/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:17.905 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291579/ - URL: https://movie.douban.com/subject/1291579/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:18.009 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1294240/ - URL: https://movie.douban.com/subject/1294240/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:18.073 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1291875/ - URL: https://movie.douban.com/subject/1291875/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:18.146 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/25814705/ - URL: https://movie.douban.com/subject/25814705/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:18.209 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292215/ - URL: https://movie.douban.com/subject/1292215/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:18.274 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1297052/ - URL: https://movie.douban.com/subject/1297052/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:18.484 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1307315/ - URL: https://movie.douban.com/subject/1307315/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:18.688 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1297518/ - URL: https://movie.douban.com/subject/1297518/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:18.893 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/6307447/ - URL: https://movie.douban.com/subject/6307447/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:19.098 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/26799731/ - URL: https://movie.douban.com/subject/26799731/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:19.303 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1292274/ - URL: https://movie.douban.com/subject/1292274/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:19.508 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/25986180/ - URL: https://movie.douban.com/subject/25986180/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:19.714 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/3287562/ - URL: https://movie.douban.com/subject/3287562/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:19.916 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/25814707/ - URL: https://movie.douban.com/subject/25814707/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:20.123 [main] WARN com.spider.service.DoubanMovieSpider - 获取票房失败: https://movie.douban.com/subject/1303037/ - URL: https://movie.douban.com/subject/1303037/, 访问被拒绝，可能需要设置User-Agent或等待一段时间
2026-05-31 18:44:20.123 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 7 页 (151): https://movie.douban.com/top250?start=150
2026-05-31 18:44:20.334 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250?start=150, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:44:20.335 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:44:20.335 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:44:20.768 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:44:20.779 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:44:20.781 [main] ERROR com.spider.service.DataStorageService - 保存书籍数据失败
java.io.FileNotFoundException: data\books.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveBooksToCsv(DataStorageService.java:94)
at com.spider.service.DataStorageService.saveBooks(DataStorageService.java:50)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:148)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:44:20.781 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 18:44:20.782 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:44:59.381 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:44:59.381 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:45:00.572 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:45:00.573 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:45:00.573 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:45:01.081 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:45:01.082 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:45:01.083 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:45:01.652 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:45:01.661 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:45:01.662 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 18:45:01.662 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 18:45:01.663 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:45:53.993 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:45:53.994 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:45:55.048 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:45:55.050 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:45:55.050 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:45:55.558 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:45:55.559 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:45:55.559 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:45:55.943 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:45:55.954 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:45:55.956 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 18:45:55.956 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 18:45:55.956 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:47:31.850 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:47:31.852 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:47:33.048 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:47:33.050 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:47:33.050 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:47:33.557 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:47:33.561 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:47:33.561 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:47:34.247 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:47:34.257 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:47:34.258 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 18:47:34.258 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 18:47:34.259 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:48:59.835 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:48:59.836 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:49:01.109 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:49:01.111 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:49:01.111 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:49:01.622 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:49:01.623 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:49:01.623 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:49:02.005 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:49:02.016 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:49:02.017 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 18:49:02.017 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 18:49:02.018 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:50:14.987 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 18:50:14.988 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 18:50:16.271 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:50:16.274 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 18:50:16.274 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 18:50:16.784 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:50:16.785 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 18:50:16.785 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 18:50:17.159 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 18:50:17.167 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 18:50:17.168 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 18:50:17.168 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 18:50:17.168 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:130)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:12:19.560 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 19:12:19.560 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 19:12:20.722 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:12:20.724 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 19:12:20.724 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 19:12:21.232 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:12:21.232 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 19:12:21.233 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 19:12:21.806 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 19:12:21.816 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:128)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:12:21.816 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 19:12:21.816 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 19:12:21.818 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:128)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:13:43.057 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 19:13:43.058 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 19:13:44.179 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:13:44.182 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 19:13:44.182 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 19:13:44.690 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:13:44.692 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 19:13:44.692 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 19:13:45.181 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 19:13:45.193 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:128)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:13:45.194 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 19:13:45.195 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 19:13:45.196 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:128)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:14:12.114 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 19:14:12.115 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 19:14:13.362 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:14:13.364 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 19:14:13.364 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 19:14:13.873 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:14:13.875 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 19:14:13.875 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 19:14:14.261 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 19:14:14.272 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:128)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:129)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:14:14.274 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 19:14:14.274 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 19:14:14.275 [main] ERROR com.spider.service.DataStorageService - 保存热搜数据失败
java.io.FileNotFoundException: data\hotsearch.csv (另一个程序正在使用此文件，进程无法访问。)
at java.base/java.io.FileOutputStream.open0(Native Method)
at java.base/java.io.FileOutputStream.open(FileOutputStream.java:293)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:235)
at java.base/java.io.FileOutputStream.<init>(FileOutputStream.java:123)
at java.base/java.io.FileWriter.<init>(FileWriter.java:66)
at com.spider.service.DataStorageService.saveHotSearchToCsv(DataStorageService.java:128)
at com.spider.service.DataStorageService.saveHotSearch(DataStorageService.java:84)
at com.spider.controller.SpiderController.saveAllData(SpiderController.java:150)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:47)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:16:46.973 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 19:16:46.973 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 19:16:48.090 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:16:48.092 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 19:16:48.092 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 19:16:48.602 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:16:48.605 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 19:16:48.605 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 19:16:49.094 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 19:16:49.103 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 19:16:49.103 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 19:16:49.104 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 19:16:49.105 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 19:17:30.989 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 19:17:30.990 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 19:17:32.122 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:17:32.126 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 19:17:32.126 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 19:17:32.632 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:17:32.634 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 19:17:32.634 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 19:17:32.916 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 19:17:32.932 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 19:17:32.934 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 19:17:32.934 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 19:17:32.935 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 19:17:58.092 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 19:17:58.093 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 19:17:59.360 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:17:59.362 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 19:17:59.362 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 19:17:59.874 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 19:17:59.877 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 19:17:59.877 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 19:18:00.365 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 19:18:00.376 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 19:18:00.376 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 19:18:00.377 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 19:18:00.379 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 22:01:59.934 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:01:59.935 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:02:01.343 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:02:01.347 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:02:01.347 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:02:01.853 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:02:01.856 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:02:01.856 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:02:02.440 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 22:02:02.453 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 22:02:02.453 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:02:02.454 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:02:02.455 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 22:02:29.477 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:02:29.478 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:02:30.630 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:02:30.634 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:02:30.634 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:02:31.244 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:02:31.246 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:02:31.246 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:02:31.741 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 22:02:31.753 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 22:02:31.755 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:02:31.755 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:02:31.757 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 22:02:47.348 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:02:47.348 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:02:48.550 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:02:48.552 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:02:48.552 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:02:49.062 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:49)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:02:49.065 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:02:49.065 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:02:49.636 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 22:02:49.647 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 22:02:49.647 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:02:49.648 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:02:49.649 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch_new.csv
2026-05-31 22:26:41.544 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:26:41.545 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:26:42.771 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:53)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:26:42.773 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:26:42.773 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:26:43.284 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:53)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:26:43.286 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:26:43.286 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:26:43.739 [main] WARN com.spider.service.BaiduHotSearchSpider - 未能解析到热搜数据，尝试备用选择器...
2026-05-31 22:26:43.740 [main] ERROR com.spider.service.BaiduHotSearchSpider - 爬取百度热搜时出错
com.spider.exception.ParseException: 无法找到热搜数据元素
at com.spider.service.BaiduHotSearchSpider.crawlHotSearch(BaiduHotSearchSpider.java:62)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:126)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:26:43.741 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:26:43.741 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:26:43.741 [main] WARN com.spider.service.DataStorageService - 没有热搜数据可保存
2026-05-31 22:27:38.147 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:27:38.148 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:27:39.399 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:53)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:27:39.402 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:27:39.402 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:27:40.120 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:53)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:27:40.121 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:27:40.122 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:27:40.571 [main] WARN com.spider.service.BaiduHotSearchSpider - 未能解析到热搜数据，尝试备用选择器...
2026-05-31 22:27:40.573 [main] ERROR com.spider.service.BaiduHotSearchSpider - 爬取百度热搜时出错
com.spider.exception.ParseException: 无法找到热搜数据元素
at com.spider.service.BaiduHotSearchSpider.crawlHotSearch(BaiduHotSearchSpider.java:78)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:126)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:27:40.573 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:27:40.573 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:27:40.573 [main] WARN com.spider.service.DataStorageService - 没有热搜数据可保存
2026-05-31 22:28:30.058 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:28:30.058 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:28:31.214 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:53)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:28:31.218 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:28:31.218 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:28:31.725 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:53)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:28:31.728 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:28:31.729 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:28:32.139 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 25311 字节
2026-05-31 22:28:32.139 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前1000字符: [#q3"e���HU��:"'��J�m����b��ؽ\�0-�q=ߓ���k�p��%�'ht�k��Nm8�$&$A�T�}��'���
l7���o�՗�NtD힘?Kj`�̮�B�����w�2�����=��C8㌒y2"JV�k���;ۗ���&�T0�V�I�����{�40;���rƌ;A�"�)�������2BU.�hWuNjx1'���f�_���g���(+����
Q;C��c�ˮ[!W��v��V�w\���"4,��{��,�����������٨��w�5�}����G9շ�Y��k�n�f��rk��E=-Z� T#�̩�,=��=�+��e�R}�w$��vH̀�uի�sfF��$���诓VN�됻�����ǘh����{�:����k0;��)X���|H���d�K�m�B @�^�1�R���kj��B�Ne���y�҅6I�Z�B"I����7�ef�1+m� cTW����-�N�cI��Xo��o�'�������x��,�@��8��ߋ39��q�@
��i�=�b�����a�jQ���G���a8�X�(c(_�,�p[XOJ��������E�K����C�a5O�*k�|#HiMQ?42��hg��a����x�?���t�_CS_ Ae��]TT�S����ϙ�(� v6��P�Lfs���vU��u?��n}����_X�dP¿Q��ul3gC���r[����h~7Wv�ۃ�D���;.�F(� �<�V/�Ñ�
1G��3
*��n��g��.�et|��턽�M���ۓz��b��)g�����������_�|�ú����B��������u\7�u ����~���;�h!D���h�8h�aV�{�W������=�/� ~P�ͯyЋ����cM\���
Zܺ�O,����vP�����q�#� ��s�v�٭���o�hޟ�ߣ%L/_��S��
�Nۍ�]�BE�#�y�S���߃8�+��>4�;|"��g6�ޙ>���TC&-��b��ީm �dWc��*�|y^�
2026-05-31 22:28:32.177 [main] WARN com.spider.service.BaiduHotSearchSpider - 未能解析到热搜数据，尝试备用选择器...
2026-05-31 22:28:32.178 [main] ERROR com.spider.service.BaiduHotSearchSpider - 爬取百度热搜时出错
com.spider.exception.ParseException: 无法找到热搜数据元素
at com.spider.service.BaiduHotSearchSpider.crawlHotSearch(BaiduHotSearchSpider.java:85)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:126)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:28:32.179 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:28:32.179 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:28:32.179 [main] WARN com.spider.service.DataStorageService - 没有热搜数据可保存
2026-05-31 22:29:11.922 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:29:11.923 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:29:13.301 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:50)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:29:13.304 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:29:13.304 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:29:13.811 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:50)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:29:13.813 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:29:13.813 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:29:14.248 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 197839 字节
2026-05-31 22:29:14.248 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前1000字符:
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<meta content="always" name="referrer">
<meta name="theme-color" content="#2932e1">
<link rel="shortcut icon" href="//www.baidu.com/favicon.ico" type="image/x-icon" />
<link rel="icon" sizes="any" mask href="//www.baidu.com/img/baidu_85beaf5496f291521eb75ba38eacbd87.svg">
<link rel="dns-prefetch" href="//fyb-pc-static.cdn.bcebos.com"/>
<meta name="keywords" content="百度热搜,百度热搜榜,百度搜索排行榜,搜索排行榜,百度热门搜索,今日热搜,今日热点,排行榜,热搜榜,热词榜,热门话题,网络热点,实时热点,热门事件,热点">
<meta name="description" content="百度热搜以数亿用户海量的真实数据为基础，通过专业的数据挖掘方法，计算关键词的热搜指数，旨在建立权威、全面、热门、时效的各类关键词排行榜，引领热词阅读时代。">
<title>百度热搜</title>
<style data-vue-ssr-id="22cfed39:0">
.c-gap-top-small
2026-05-31 22:29:14.305 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 22:30:05.924 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:30:05.926 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:30:07.165 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:50)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:30:07.168 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:30:07.169 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:30:07.777 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:50)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:30:07.779 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:30:07.780 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:31:00.979 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:31:00.980 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:31:02.051 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:50)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:31:02.054 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:31:02.055 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:31:02.664 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:50)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:31:02.665 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:31:02.666 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:31:03.283 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 197986 字节
2026-05-31 22:31:03.283 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前2000字符:
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<meta content="always" name="referrer">
<meta name="theme-color" content="#2932e1">
<link rel="shortcut icon" href="//www.baidu.com/favicon.ico" type="image/x-icon" />
<link rel="icon" sizes="any" mask href="//www.baidu.com/img/baidu_85beaf5496f291521eb75ba38eacbd87.svg">
<link rel="dns-prefetch" href="//fyb-pc-static.cdn.bcebos.com"/>
<meta name="keywords" content="百度热搜,百度热搜榜,百度搜索排行榜,搜索排行榜,百度热门搜索,今日热搜,今日热点,排行榜,热搜榜,热词榜,热门话题,网络热点,实时热点,热门事件,热点">
<meta name="description" content="百度热搜以数亿用户海量的真实数据为基础，通过专业的数据挖掘方法，计算关键词的热搜指数，旨在建立权威、全面、热门、时效的各类关键词排行榜，引领热词阅读时代。">
<title>百度热搜</title>
<style data-vue-ssr-id="22cfed39:0">
.c-gap-top-small {
margin-top: 3px;
}
.c-gap-top {
margin-top: 7px;
}
.c-gap-top-large {
margin-top: 11px;
}
.c-gap-top-mini {
margin-top: 2px;
}
.c-gap-top-xsmall {
margin-top: 4px;
}
.c-gap-top-middle {
margin-top: 10px;
}
.c-gap-bottom-small {
margin-bottom: 3px;
}
.c-gap-bottom {
margin-bottom: 7px;
}
.c-gap-bottom-large {
margin-bottom: 11px;
}
.c-gap-bottom-mini {
margin-bottom: 2px;
}
.c-gap-bottom-xsmall {
margin-bottom: 4px;
}
.c-gap-bottom-middle {
margin-bottom: 10px;
}
.c-gap-left {
margin-left: 12px;
}
.c-gap-left-small {
margin-left: 8px;
}
.c-gap-left-xsmall {
margin-left: 4px;
}
.c-gap-left-mini {
margin-left: 2px;
}
.c-gap-left-large {
margin-left: 16px;
}
.c-gap-left-middle {
margin-left: 10px;
}
.c-gap-right {
margin-right: 12px;
}
.c-gap-right-small {
margin-right: 8px;
}
.c-gap-right-xsmall {
margin-right: 4px;
}
.c-gap-right-mini {
margin-right: 2px;
}
.c-gap-right-large {
margin-right: 16px;
}
.c-gap-right-middle {
margin-right: 10
2026-05-31 22:31:03.348 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 22:31:54.446 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:31:54.448 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:31:55.707 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:50)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:31:55.709 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:31:55.709 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:31:56.221 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:50)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:31:56.225 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:31:56.225 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:31:56.655 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 197986 字节
2026-05-31 22:31:56.655 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前2000字符:
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<meta content="always" name="referrer">
<meta name="theme-color" content="#2932e1">
<link rel="shortcut icon" href="//www.baidu.com/favicon.ico" type="image/x-icon" />
<link rel="icon" sizes="any" mask href="//www.baidu.com/img/baidu_85beaf5496f291521eb75ba38eacbd87.svg">
<link rel="dns-prefetch" href="//fyb-pc-static.cdn.bcebos.com"/>
<meta name="keywords" content="百度热搜,百度热搜榜,百度搜索排行榜,搜索排行榜,百度热门搜索,今日热搜,今日热点,排行榜,热搜榜,热词榜,热门话题,网络热点,实时热点,热门事件,热点">
<meta name="description" content="百度热搜以数亿用户海量的真实数据为基础，通过专业的数据挖掘方法，计算关键词的热搜指数，旨在建立权威、全面、热门、时效的各类关键词排行榜，引领热词阅读时代。">
<title>百度热搜</title>
<style data-vue-ssr-id="22cfed39:0">
.c-gap-top-small {
margin-top: 3px;
}
.c-gap-top {
margin-top: 7px;
}
.c-gap-top-large {
margin-top: 11px;
}
.c-gap-top-mini {
margin-top: 2px;
}
.c-gap-top-xsmall {
margin-top: 4px;
}
.c-gap-top-middle {
margin-top: 10px;
}
.c-gap-bottom-small {
margin-bottom: 3px;
}
.c-gap-bottom {
margin-bottom: 7px;
}
.c-gap-bottom-large {
margin-bottom: 11px;
}
.c-gap-bottom-mini {
margin-bottom: 2px;
}
.c-gap-bottom-xsmall {
margin-bottom: 4px;
}
.c-gap-bottom-middle {
margin-bottom: 10px;
}
.c-gap-left {
margin-left: 12px;
}
.c-gap-left-small {
margin-left: 8px;
}
.c-gap-left-xsmall {
margin-left: 4px;
}
.c-gap-left-mini {
margin-left: 2px;
}
.c-gap-left-large {
margin-left: 16px;
}
.c-gap-left-middle {
margin-left: 10px;
}
.c-gap-right {
margin-right: 12px;
}
.c-gap-right-small {
margin-right: 8px;
}
.c-gap-right-xsmall {
margin-right: 4px;
}
.c-gap-right-mini {
margin-right: 2px;
}
.c-gap-right-large {
margin-right: 16px;
}
.c-gap-right-middle {
margin-right: 10
2026-05-31 22:31:56.712 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 22:31:56.723 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 22:31:56.724 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:31:56.724 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:31:56.725 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 22:33:18.397 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:33:18.398 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:33:20.291 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 所有获取方式都失败: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:39)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtmlWithHttpClient(HttpClientUtil.java:63)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:37)
... 4 common frames omitted
2026-05-31 22:33:20.294 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:33:20.294 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:33:21.519 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 所有获取方式都失败: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:39)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtmlWithHttpClient(HttpClientUtil.java:63)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:37)
... 4 common frames omitted
2026-05-31 22:33:21.520 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:33:21.521 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:33:22.078 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 212903 字节
2026-05-31 22:33:22.078 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前2000字符: <!doctype html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<meta content="always" name="referrer">
<meta name="theme-color" content="#2932e1">
<link rel="shortcut icon" href="//www.baidu.com/favicon.ico" type="image/x-icon">
<link rel="icon" sizes="any" mask href="//www.baidu.com/img/baidu_85beaf5496f291521eb75ba38eacbd87.svg">
<link rel="dns-prefetch" href="//fyb-pc-static.cdn.bcebos.com">
<meta name="keywords" content="百度热搜,百度热搜榜,百度搜索排行榜,搜索排行榜,百度热门搜索,今日热搜,今日热点,排行榜,热搜榜,热词榜,热门话题,网络热点,实时热点,热门事件,热点">
<meta name="description" content="百度热搜以数亿用户海量的真实数据为基础，通过专业的数据挖掘方法，计算关键词的热搜指数，旨在建立权威、全面、热门、时效的各类关键词排行榜，引领热词阅读时代。">
<title>百度热搜</title>
<style data-vue-ssr-id="22cfed39:0">
.c-gap-top-small {
margin-top: 3px;
}
.c-gap-top {
margin-top: 7px;
}
.c-gap-top-large {
margin-top: 11px;
}
.c-gap-top-mini {
margin-top: 2px;
}
.c-gap-top-xsmall {
margin-top: 4px;
}
.c-gap-top-middle {
margin-top: 10px;
}
.c-gap-bottom-small {
margin-bottom: 3px;
}
.c-gap-bottom {
margin-bottom: 7px;
}
.c-gap-bottom-large {
margin-bottom: 11px;
}
.c-gap-bottom-mini {
margin-bottom: 2px;
}
.c-gap-bottom-xsmall {
margin-bottom: 4px;
}
.c-gap-bottom-middle {
margin-bottom: 10px;
}
.c-gap-left {
margin-left: 12px;
}
.c-gap-left-small {
margin-left: 8px;
}
.c-gap-left-xsmall {
margin-left: 4px;
}
.c-gap-left-mini {
margin-left: 2px;
}
.c-gap-left-large {
margin-left: 16px;
}
.c-gap-left-middle {
margin-left: 10px;
}
.c-gap-right {
margin-right: 12px;
}
.c-gap-right-small {
margin-right: 8px;
}
.c-gap-right-xsmall {
margin-right: 4px;
}
.c-gap-right-mini {
margin-right: 2px;
}
.c-gap-right-large {
margin-right: 16px;
}
.c-gap-right-middle {
margin-right: 10px;
}
.c-gap-icon-right-small {
margin-right: 5px;
}
.c-gap-icon-right {
margin-right: 10px;
}
.c-gap-icon-left-small {
margin-left: 5px;
}
.c-gap-icon-left {
margin-left: 10px;
2026-05-31 22:33:22.102 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 22:33:22.113 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 22:33:22.113 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:33:22.113 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:33:22.116 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 22:33:49.781 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:33:49.781 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:33:51.729 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 所有获取方式都失败: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:39)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtmlWithHttpClient(HttpClientUtil.java:63)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:37)
... 4 common frames omitted
2026-05-31 22:33:51.731 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:33:51.731 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:33:52.955 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 所有获取方式都失败: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:39)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtmlWithHttpClient(HttpClientUtil.java:63)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:37)
... 4 common frames omitted
2026-05-31 22:33:52.958 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:33:52.958 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:33:53.491 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 212903 字节
2026-05-31 22:33:53.491 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前2000字符: <!doctype html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<meta content="always" name="referrer">
<meta name="theme-color" content="#2932e1">
<link rel="shortcut icon" href="//www.baidu.com/favicon.ico" type="image/x-icon">
<link rel="icon" sizes="any" mask href="//www.baidu.com/img/baidu_85beaf5496f291521eb75ba38eacbd87.svg">
<link rel="dns-prefetch" href="//fyb-pc-static.cdn.bcebos.com">
<meta name="keywords" content="百度热搜,百度热搜榜,百度搜索排行榜,搜索排行榜,百度热门搜索,今日热搜,今日热点,排行榜,热搜榜,热词榜,热门话题,网络热点,实时热点,热门事件,热点">
<meta name="description" content="百度热搜以数亿用户海量的真实数据为基础，通过专业的数据挖掘方法，计算关键词的热搜指数，旨在建立权威、全面、热门、时效的各类关键词排行榜，引领热词阅读时代。">
<title>百度热搜</title>
<style data-vue-ssr-id="22cfed39:0">
.c-gap-top-small {
margin-top: 3px;
}
.c-gap-top {
margin-top: 7px;
}
.c-gap-top-large {
margin-top: 11px;
}
.c-gap-top-mini {
margin-top: 2px;
}
.c-gap-top-xsmall {
margin-top: 4px;
}
.c-gap-top-middle {
margin-top: 10px;
}
.c-gap-bottom-small {
margin-bottom: 3px;
}
.c-gap-bottom {
margin-bottom: 7px;
}
.c-gap-bottom-large {
margin-bottom: 11px;
}
.c-gap-bottom-mini {
margin-bottom: 2px;
}
.c-gap-bottom-xsmall {
margin-bottom: 4px;
}
.c-gap-bottom-middle {
margin-bottom: 10px;
}
.c-gap-left {
margin-left: 12px;
}
.c-gap-left-small {
margin-left: 8px;
}
.c-gap-left-xsmall {
margin-left: 4px;
}
.c-gap-left-mini {
margin-left: 2px;
}
.c-gap-left-large {
margin-left: 16px;
}
.c-gap-left-middle {
margin-left: 10px;
}
.c-gap-right {
margin-right: 12px;
}
.c-gap-right-small {
margin-right: 8px;
}
.c-gap-right-xsmall {
margin-right: 4px;
}
.c-gap-right-mini {
margin-right: 2px;
}
.c-gap-right-large {
margin-right: 16px;
}
.c-gap-right-middle {
margin-right: 10px;
}
.c-gap-icon-right-small {
margin-right: 5px;
}
.c-gap-icon-right {
margin-right: 10px;
}
.c-gap-icon-left-small {
margin-left: 5px;
}
.c-gap-icon-left {
margin-left: 10px;
2026-05-31 22:33:53.511 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜
2026-05-31 22:33:53.522 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 22:33:53.523 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:33:53.523 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:33:53.524 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv
2026-05-31 22:43:54.328 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:43:54.329 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:43:59.474 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 所有获取方式都失败: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:47)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtmlWithHttpClient(HttpClientUtil.java:81)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:45)
... 4 common frames omitted
2026-05-31 22:43:59.477 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:43:59.477 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:44:03.775 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 所有获取方式都失败: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:47)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 访问被拒绝，可能需要设置User-Agent或等待一段时间
at com.spider.utils.HttpClientUtil.fetchHtmlWithHttpClient(HttpClientUtil.java:81)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:45)
... 4 common frames omitted
2026-05-31 22:44:03.775 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:44:03.775 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:44:07.303 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 38373 字节
2026-05-31 22:44:07.304 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前2000字符: <html>
<head></head>
<body>
[�p3"e���HU��:"'�&#x1e;&#x0;�J�m&#x6;����b��ؽ&#xe;&#x1c;\�0-�q=ߓ���k�p��%�'ht&#x2;�k��Nm8�&#x4;$&amp;$A�T�}&#x1e;��'��� l7���o�՗�NtD힘?Kj`�̮�&#x13;B�����w�2��&#x0;���=��C8㌒y2"JV&#x19;����u��=�ٲ�* � 9�A��r���&#x1f;��v�.�7&#xe;k�����B&#x14;ql��ԕ�&#x14;���~U�qõ@F�B��%v�&#x0;��x&#x11;/�d&#x16;4��&#x0;��^����&#x17;eeS�&#x0;6P�"JbgH�pl|�u+��&#x16;�e�&#x1e;�RIOȥ��a1�Jx ��&#x18;g��&#x1f;���uW�=ث�&#x1;��95��B��k��&#x1;���;1���)@%tߜ��&#x15;&#x16;���� !M��_[�v[ֻ�&amp;�7 �����I�ӻ�@��`n�D� E��W�g��W�&#x1e;���h�fS��z_�]}9瀐�&#x1;��&#x8;�w��&#x17;2s~ fǢ�&gt;&#x5;&#xb;QP�&#xf;)�"?�l|���XB�&#x3;&#x4;HӋɘ����-(&#x4;9��j��үw&#x1d;ڪ�La&amp; �&amp;c�����Z&#x5;I!$3�\����&#x4;o)� �e�&#x5;�+�3{ SDF&#x16;�mB��&#x8;vo��#f� ��&gt;&#x0;'�5��7&#xe;xy���LN(z�G-�B�0w�}&#xf;��X�6��r&#x18;�Z&#x14;&gt;���/y&#x18;�8��_8�&#x18;��&lt;&#xb;&#x4;3�&#x16;֓�0�f(3��;DQ�ҵ0~�&#x10;tX�S��ʚ"�&#x8;RZS�&#xf;� ?,�٧{&#x18;��i:��&#xf;�+.]����&#x17;CP��Gz&#x17;&#x15;�����&#x3;-�u�s��' s��M�5T:��\&amp;q�]&#x15;�&#x1;y��&#xf;��[��w7�&#x17;&#x16;6&#x19;��o&#x14;gy&#x1d;����ea&#x7;������7;��͕&#x1d;�� 8���!;o��K�&#x11;J#�!Ͼ�&#xb;�p�dC���G茂������=��ٷz��n&#x19;&#x1d;_�x;aoq�y&#x7;}�����p��#tʙ�e&amp;e���;=�ï�W)���8������Á�~&#x1d;׍&#x1d;C࿇�&#x5;��?���&gt;Z&#x8;��:0ځ3&#xe;�y���&#x1e;��3��=�w���&#xb;~&#x5;�&#x1f;�a�k&#x1e;���)n��X�&#x7;&#x17;�)��&#x0;x�&#x16;�n�&#x13;&#x0;��3�&#x4;���&#x1d;T�h!7&#x2;r&#x1c;�H#C�����&lt;�m�&#x1d;nvk����6��'&#x0;���h &#x13;��&#x17;*��嵀���v�`׵PQ�Ȅd��T�h�� ���4�&#xf; �&#xe;�&#x8;�&#x6;&#x0;��M�w�&#xf;�i1ՐI&#xb;��&#x18;zc�wj&#x1b;C9���g���9_���&#xf;F�u�2{&#x1c;��W��Q���C����7_*ɮ�&gt;�5X��#1?��&#x1e;���:��N&#x1;&amp;W�o��B���&#x1;�|�W-&#x7;��&#x1e;f�"^X�@&#xf;�d&#x1;$���O&#x18;Ņ&#x0;UrWk&#xf;�&#x18;dB����l&#x8;�&#x1c;� &#x1d;�&#x0;Ω˜r�၊H�,@5x&#x10;{��Ն&#x1d;M�9�[ 0�#}G��+}/!-`&#x11;^:&#x1e;&#x0;0"h"��R.J�px���nM�(�8i)&#xe;&#x3;�4����&#x16;NÏ)�&#x1;ZW&#xe;?���D�螘��`���&#x18;�ߓ&#x10;6X�$y*I�&#xb;\�ܖ&#x8;&#x18;�� �31roE��KspL`0)&#x11;�&#x1a;'�&#x3;t� �&#x1;1� �&#x1;5
2026-05-31 22:44:07.319 [main] WARN com.spider.service.BaiduHotSearchSpider - 未能解析到热搜数据，尝试备用选择器...
2026-05-31 22:44:07.322 [main] ERROR com.spider.service.BaiduHotSearchSpider - 爬取百度热搜时出错
com.spider.exception.ParseException: 无法找到热搜数据元素
at com.spider.service.BaiduHotSearchSpider.crawlHotSearch(BaiduHotSearchSpider.java:81)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:126)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:44:07.324 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:44:07.324 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:44:07.324 [main] WARN com.spider.service.DataStorageService - 没有热搜数据可保存
2026-05-31 22:45:03.928 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:45:03.929 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:45:17.483 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:45:17.484 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:45:21.397 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 所有获取方式都失败: HTTP error fetching URL. Status=418, URL=[https://sec.douban.com/b?r=https%3A%2F%2Fbook.douban.com%2Fchart%3Fsub_type%3D1]
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:46)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: org.jsoup.HttpStatusException: HTTP error fetching URL. Status=418, URL=[https://sec.douban.com/b?r=https%3A%2F%2Fbook.douban.com%2Fchart%3Fsub_type%3D1]
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:890)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:887)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:829)
at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:366)
at org.jsoup.helper.HttpConnection.get(HttpConnection.java:353)
at com.spider.utils.HttpClientUtil.fetchHtmlWithJsoup(HttpClientUtil.java:104)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:44)
... 4 common frames omitted
2026-05-31 22:45:21.400 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:45:21.400 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:45:24.672 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 所有获取方式都失败: HTTP error fetching URL. Status=418, URL=[https://sec.douban.com/b?r=https%3A%2F%2Fmovie.douban.com%2Ftop250]
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:46)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: org.jsoup.HttpStatusException: HTTP error fetching URL. Status=418, URL=[https://sec.douban.com/b?r=https%3A%2F%2Fmovie.douban.com%2Ftop250]
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:890)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:887)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:829)
at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:366)
at org.jsoup.helper.HttpConnection.get(HttpConnection.java:353)
at com.spider.utils.HttpClientUtil.fetchHtmlWithJsoup(HttpClientUtil.java:104)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:44)
... 4 common frames omitted
2026-05-31 22:45:24.674 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:45:24.674 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:45:27.132 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 25205 字节
2026-05-31 22:45:27.132 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前2000字符: [�p3"e���HU��:"'��J�m����b��ؽ\�0-�q=ߓ���k�p��%�'ht�k��Nm8�$&$A�T�}��'���
l7���o�՗�NtD힘?Kj`�̮�B�����w�2�����=��C8㌒y2"JV����u��=�ٲ�*
� 9�A��r�����v�.�7k�����Bql��ԕ����~U�qõ@F�B��%v���x/�d4����^����eeS�6P�"JbgH�pl|�u+��֮���VJ�-g3c{#9D:�_��l�ў�dq���g����y��q �k\M��w
��G��Zk����cS��r-c����8H>
���L���� ����3�vz׉ ��� .��^u��>_�{DF��q�M����}iv��9�
X�F�{��YJ���X�ۧ`!
��!�V�g��/u�K}�iz1S��׶� g��P��2^���C[�)�$aUe��5���cKz9�ᰱ��+xB�����ejᜲ�
|B舞���UI��$߄K����d�:��/��^�� E��R��N��APk�צ�P�U���g>Z�%���� GC��g�`���zR� eV|�(J\��o��y*�WYS�AJk�����E;�t��?M����tť����b*��HZ���{�%��xΔ�DaN�� ��Jg2��$> �;���w�������&����,�c�9�,���ۚ|�fG󻹲#�'�?d�p�q�4Bi1�ٷz���l�9z<��QP��5p��g�;�V/t�-��+o'�-n:�oߞ��s�N93�̤�w�u�u�u�*����rt��\u8�ݯ��c��0����Ǖ��G !�^F;p�A;���üz�W�g���}��`��:l~̓^�8��}k���7�o��֍~`Q��xз�J-�F@��id���{��G�����n
�w�F�� ��-a�x�B����P�w�n�*���̻��
��\���������>� ����5-�2i��Co��Nmc('���U�8���2��(���Rf������6J��s���K%���g��r$�|���R���)���͓W�]�=4`������ìX� ����,���<q� ���J�j��LW5�
�㸡��9u�S�:<P ��b���ڰ�i�7�wKFu��h�}��%�,�K�FM�T�E)o�pխ)�'-�a`��t�=��i�1�4@������h����2��{���$O%I~�����[ax&F��ri� &%"_�$�o��> �9��a�|��[���1-7~XVg��n@Yt��h��P� G-Z�(Et�����C���J w�d�R���y�&�f����($��$ ���Ȳlp�亞(�5�C�^��M�!�v��M�4f�yc�8i,����ԍxaR�0HV������<;�`J�t���b���B� �"��Cl���=��9>���;^� m
�x��;�;�Y�9A�т�845+(�{�u�#/KZ����q�#�G�<��!�ד��ɨ��+��`c���� ��c=�ŠO(�O� K����K����O��P)��U>?�c�ǩ��rA�L�QB���4�f2Qh�g�*C缜�<�ٟ6��&ma�L.&A������;��ĶX„��9ݵ�S"��cƦڝ��0&�����ǽ܉�
�ž �Io�;Q`��_$3a/sB(z���=)�n��-� ?�$ �]������t�9�~�I�� g�=��?)ZL
��}�$���*k3�̥��c�ʴ|�;��k��e��3ĩ�c~]Kǖ��ؾ���#݃R:�f���n�qp�$2�c����&+���2�A��4�l�L��OX����\�R:� ��tIG~2���s��kӥ@h�:HW}ɗ|)�c�^<�(X���
�5oReG��/��q��-k��쉓b�EX�~�ARwܯ4z�J^�p7MSX�K�1?pń8���Î�g+J�l�36Kf�3�ѥ3;�`)�=,�L`��>cJqb�e�\�Y]%�Lnc<NKo�Bu�
�аPf�9��ԣ5��:�>�ɍ$�$����
2026-05-31 22:45:27.174 [main] WARN com.spider.service.BaiduHotSearchSpider - 未能解析到热搜数据，尝试备用选择器...
2026-05-31 22:45:27.175 [main] ERROR com.spider.service.BaiduHotSearchSpider - 爬取百度热搜时出错
com.spider.exception.ParseException: 无法找到热搜数据元素
at com.spider.service.BaiduHotSearchSpider.crawlHotSearch(BaiduHotSearchSpider.java:81)
at com.spider.controller.SpiderController.crawlBaiduHotSearch(SpiderController.java:126)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:44)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
2026-05-31 22:45:27.175 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存
2026-05-31 22:45:27.175 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存
2026-05-31 22:45:27.175 [main] WARN com.spider.service.DataStorageService - 没有热搜数据可保存
2026-05-31 22:46:31.484 [main] INFO com.spider.service.DoubanBookSpider - 开始爬取豆瓣读书热度最高的 50 本书...
2026-05-31 22:46:31.485 [main] INFO com.spider.service.DoubanBookSpider - 正在抓取第 1 页: https://book.douban.com/chart?sub_type=1
2026-05-31 22:46:35.433 [main] ERROR com.spider.service.DoubanBookSpider - 爬取豆瓣读书时出错
com.spider.exception.NetworkException: URL: https://book.douban.com/chart?sub_type=1, 所有获取方式都失败: HTTP error fetching URL. Status=418, URL=[https://sec.douban.com/b?r=https%3A%2F%2Fbook.douban.com%2Fchart%3Fsub_type%3D1]
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:46)
at com.spider.service.DoubanBookSpider.crawlHotBooks(DoubanBookSpider.java:55)
at com.spider.controller.SpiderController.crawlDoubanBooks(SpiderController.java:66)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:38)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: org.jsoup.HttpStatusException: HTTP error fetching URL. Status=418, URL=[https://sec.douban.com/b?r=https%3A%2F%2Fbook.douban.com%2Fchart%3Fsub_type%3D1]
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:890)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:887)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:829)
at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:366)
at org.jsoup.helper.HttpConnection.get(HttpConnection.java:353)
at com.spider.utils.HttpClientUtil.fetchHtmlWithJsoup(HttpClientUtil.java:99)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:44)
... 4 common frames omitted
2026-05-31 22:46:35.437 [main] INFO com.spider.service.DoubanMovieSpider - 开始爬取豆瓣电影Top250...
2026-05-31 22:46:35.437 [main] INFO com.spider.service.DoubanMovieSpider - 正在抓取第 1 页 (1): https://movie.douban.com/top250
2026-05-31 22:46:38.708 [main] ERROR com.spider.service.DoubanMovieSpider - 爬取豆瓣电影时出错
com.spider.exception.NetworkException: URL: https://movie.douban.com/top250, 所有获取方式都失败: HTTP error fetching URL. Status=418, URL=[https://sec.douban.com/b?r=https%3A%2F%2Fmovie.douban.com%2Ftop250]
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:46)
at com.spider.service.DoubanMovieSpider.crawlTop250(DoubanMovieSpider.java:51)
at com.spider.controller.SpiderController.crawlDoubanMovies(SpiderController.java:96)
at com.spider.core.SpiderRunner.runOneClickMode(SpiderRunner.java:41)
at com.spider.core.SpiderRunner.main(SpiderRunner.java:20)
Caused by: org.jsoup.HttpStatusException: HTTP error fetching URL. Status=418, URL=[https://sec.douban.com/b?r=https%3A%2F%2Fmovie.douban.com%2Ftop250]
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:890)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:887)
at org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:829)
at org.jsoup.helper.HttpConnection.execute(HttpConnection.java:366)
at org.jsoup.helper.HttpConnection.get(HttpConnection.java:353)
at com.spider.utils.HttpClientUtil.fetchHtmlWithJsoup(HttpClientUtil.java:99)
at com.spider.utils.HttpClientUtil.fetchHtml(HttpClientUtil.java:44)
... 4 common frames omitted
2026-05-31 22:46:38.710 [main] INFO com.spider.service.BaiduHotSearchSpider - 开始爬取百度实时热搜榜前 50 条...
2026-05-31 22:46:38.711 [main] INFO com.spider.service.BaiduHotSearchSpider - 正在抓取: https://top.baidu.com/board?tab=realtime
2026-05-31 22:46:41.170 [main] INFO com.spider.service.BaiduHotSearchSpider - 获取到HTML长度: 197826 字节
2026-05-31 22:46:41.170 [main] INFO com.spider.service.BaiduHotSearchSpider - HTML内容前2000字符:
<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<meta content="always" name="referrer">
<meta name="theme-color" content="#2932e1">
<link rel="shortcut icon" href="//www.baidu.com/favicon.ico" type="image/x-icon" />
<link rel="icon" sizes="any" mask href="//www.baidu.com/img/baidu_85beaf5496f291521eb75ba38eacbd87.svg">
<link rel="dns-prefetch" href="//fyb-pc-static.cdn.bcebos.com"/>
<meta name="keywords" content="百度热搜,百度热搜榜,百度搜索排行榜,搜索排行榜,百度热门搜索,今日热搜,今日热点,排行榜,热搜榜,热词榜,热门话题,网络热点,实时热点,热门事件,热点">
<meta name="description" content="百度热搜以数亿用户海量的真实数据为基础，通过专业的数据挖掘方法，计算关键词的热搜指数，旨在建立权威、全面、热门、时效的各类关键词排行榜，引领热词阅读时代。">
<title>百度热搜</title>
<style data-vue-ssr-id="22cfed39:0">
.c-gap-top-small {
margin-top: 3px;
}
.c-gap-top {
margin-top: 7px;
}
.c-gap-top-large {
margin-top: 11px;
}
.c-gap-top-mini {
margin-top: 2px;
}
.c-gap-top-xsmall {
margin-top: 4px;
}
.c-gap-top-middle {
margin-top: 10px;
}
.c-gap-bottom-small {
margin-bottom: 3px;
}
.c-gap-bottom {
margin-bottom: 7px;
}
.c-gap-bottom-large {
margin-bottom: 11px;
}
.c-gap-bottom-mini {
margin-bottom: 2px;
}
.c-gap-bottom-xsmall {
margin-bottom: 4px;
}
.c-gap-bottom-middle {
margin-bottom: 10px;
}
.c-gap-left {
margin-left: 12px;
}
.c-gap-left-small {
margin-left: 8px;
}
.c-gap-left-xsmall {
margin-left: 4px;
}
.c-gap-left-mini {
margin-left: 2px;
}
.c-gap-left-large {
margin-left: 16px;
}
.c-gap-left-middle {
margin-left: 10px;
}
.c-gap-right {
margin-right: 12px;
}
.c-gap-right-small {
margin-right: 8px;
}
.c-gap-right-xsmall {
margin-right: 4px;
}
.c-gap-right-mini {
margin-right: 2px;
} .c-gap-right-large { margin-right: 16px; } .c-gap-right-middle { margin-right: 10 2026-05-31 22:46:41.227 [main] INFO com.spider.service.BaiduHotSearchSpider - 百度热搜爬取完成，共获取 50 条热搜 2026-05-31 22:46:41.239 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv 2026-05-31 22:46:41.240 [main] WARN com.spider.service.DataStorageService - 没有书籍数据可保存 2026-05-31 22:46:41.240 [main] WARN com.spider.service.DataStorageService - 没有电影数据可保存 2026-05-31 22:46:41.242 [main] INFO com.spider.service.DataStorageService - 热搜数据已保存到: data\hotsearch.csv