
scrapy website Article and link ...
scrapy website Article and link ...

0x01 Create a New Project 0x02 Define the Goal 0x03 Build the Spider 0x04 Store the Content
e.g.
pip3 install lxml,scrapy
Article Title Article_Title
//*[@id="wrapper"]/main/div/article/header/h5/a/text()
//*[@id="wrapper"]/main/div/article/header/h5/a
Article Link Article_Link
//*[@id="wrapper"]/main/div/article/header/h5/a/@href
Article Time Article_Time
//*[@id="wrapper"]/main/div/article/header/section/span/time[1]
Article Tag Article_Tag
//*[@id="wrapper"]/main/div/article/header/section/a
Article Introduction Article_Introduction
//*[@id="wrapper"]/main/div/article/section/text()
Next Page
//*[@id="wrapper"]/main/div/nav/a[@class="older-posts"]/@href[2]
scrapy crawl SeebugSpider -o seebug.csv
{
'Article_Author': 'Translator: Knownsec 404 Lab Translation Team',
'Article_Link': 'https://paper.seebug.org/1230/',
'Article_Origin_Link': 'Original link: Cycldek: Bridging the (air) gap ',
'Article_Summary': 'While investigating the attack activities of the Cycldek organization after 2018, it was found that for the organization...',
'Article_Tag': 'Threat Intelligence',
'Article_Time': 'June 4, 2020',
'Article_Title': 'Kaspersky Report: Information on the Knowledge Gap Regarding the Cycldek Hacker Group'
}

https://www.cnblogs.com/superhin/p/12600358.html
from selenium import webdriver
driver = webdriver.Chrome()
driver.get('https://www.qq.com/')
# 1. Execute the Chrome DevTools command to get the MHTML content
res = driver.execute_cdp_cmd('Page.captureSnapshot', {})
# 2. Write to file
with open('qq.mhtml', 'w') as f:
f.write(res['data'])
driver.quit()
| December 10, 2020 |
|---|
| 2020/11/25 | rcoil | [Knowledge Review] Cobalt Strike 4.0 Authentication and Patching Process | https://xz.aliyun.com/t/8557 |
|---|
| 2020/7/17 | uknow | Use ReflectiveDLL to Arm Your Cobalt Strike | https://xz.aliyun.com/t/7997 |
| 2020/7/17 | treebacker | Analysis of Metasploit & CobaltStrike Shellcode | https://xz.aliyun.com/t/7996 |
| 2020/4/3 | 利华 | All You Need to Know About CobaltStrike DNS Beacon | https://xz.aliyun.com/t/7488 |
| 2020/3/10 | castiel | Cobalt Strike Tinkering: A Record of Pitfalls Encountered and Fixed | https://xz.aliyun.com/t/7375 |
| 2019/11/12 | Fazx | Cobaltstrike Server Persistence & Mutual Shell Spawning Between Cobaltstrike and Metasploit | https://xz.aliyun.com/t/6722 |
| 2019/10/21 | rcoil | Cobalt Strike's ExternalC2 | https://xz.aliyun.com/t/6565 |
| 2019/9/7 | CoolCat | A Detailed Look at Cobalt Strike Process Injection | https://xz.aliyun.com/t/6205 |
| 2019/9/5 | CoolCat | Official CobaltStrike Plugin Development Guide Part 4 | https://xz.aliyun.com/t/6189 |
| 2019/9/4 | CoolCat | Official CobaltStrike Plugin Development Guide Part 3 | https://xz.aliyun.com/t/6188 |
| 2019/8/10 | CoolCat | Official CobaltStrike Plugin Development Guide Part 2 | https://xz.aliyun.com/t/5892 |
| 2019/8/8 | CoolCat | Official CobaltStrike Plugin Development Guide Part 1 | https://xz.aliyun.com/t/5887 |
| 2019/8/7 | CoolCat | A First Look at CobaltStrike Privilege Maintenance and Its Automation | https://xz.aliyun.com/t/5881 |
| 2019/2/24 | arr0w1 | Penetration Weapon Cobalt Strike - Part 2: APT-Level Comprehensive AV Evasion vs. Enterprise Defense-in-Depth | https://xz.aliyun.com/t/4191 |
| 2018/9/24 | SoftNight | In-Depth Study of Cobalt Strike Malleable C2 Configuration Files | https://xz.aliyun.com/t/2796 |
| 2018/4/2 | mss**** | In-Depth Exploration of the Cobalt Strike ExternalC2 Framework | https://xz.aliyun.com/t/2239 |
| 2018/3/18 | mss**** | Cobalt Strike: Using Obfuscation to Bypass Windows Defender | https://xz.aliyun.com/t/2173 |
| 2018/3/16 | lz1y | [Software Security] Patching Cobalt Strike 3.8 to Remove the Backdoor and Repair Features | https://xz.aliyun.com/t/2170 |
| 2017/4/14 | backlion | Cobalt Strike Setup and Usage, and Bypassing Antivirus Software | https://xz.aliyun.com/t/199 |
| November 26, 2020 | Translator: Knownsec 404 Lab Translation Team | Egregor Ransomware Uses Cobalt Strike and Rclone for Persistent Attacks | https://paper.seebug.org/1409/ |
|---|
| September 28, 2020 | Author: Keyi | Cobalt Strike Bypassing Traffic Auditing | https://paper.seebug.org/1349/ |
| June 22, 2020 | Translator: Knownsec 404 Lab Translation Team | Multi-Stage APT Attacks Use C2 Capabilities to Minimize Cobalt Strike | https://paper.seebug.org/1250/ |
| April 30, 2020 | Author: Venustech ADLab | Special Analysis of In-the-Wild Exploitation of the Penetration Weapon Cobalt Strike | https://paper.seebug.org/1190/ |
| March 12, 2020 | Author: Snowming | Cobalt Strike 4.0 Manual — Advanced Threat Tactics for Penetration Testers | https://paper.seebug.org/1143/ |
| Does CS 4.1 Really Have a Backdoor? |
|---|
| http://mp.weixin.qq.com/s?__biz=MzAwMzYxNzc1OA==&mid=2247488764&idx=1&sn=f22aa97f29bc1859abc99927cae8b8d4 |
|---|
| December 9, 2020 | A First Look at the CobaltStrike Secondary Development Environment | http://mp.weixin.qq.com/s?__biz=MzAwMzYxNzc1OA==&mid=2247488706&idx=1&sn=83474fa317248dee4aef37444c50d154 |
| August 3, 2020 | From DNS Beacon to Domain Controller | http://mp.weixin.qq.com/s?__biz=MzAwMzYxNzc1OA==&mid=2247485914&idx=1&sn=95a424874d8bbc656bb5a067198e4227 |