Python for Cybersecurity and Data Analytics

Python 開發環境

Anaconda Python: https://www.anaconda.com/products/individual

1. jupyter- 互動式寫程式用的Web介面，非常常用來教學與練習，介於Python iteractive command以及IDE工具之間。

2. SciPy

3. Spyder- Python IDE

4. Numpy

5. DASK?

6. Bokeh- 畫圖的，很華麗- https://towardsdatascience.com/data-visualization-with-bokeh-in-python-part-one-getting-started-a11655a467d4

   1. seaborn, https://seaborn.pydata.org/examples/index.html, https://seaborn.pydata.org/examples/scatter_bubbles.html

   2. networkx: social network

7. Matplotlib

8. scikit-learn: machine learning and data mining library

9. Pandas- python套件，試算表計算

10. TensorFlow- Deep learning library

11. Pytorch- https://pytorch.org/ (AI)

12. CONDA- anaconda 套件管理工具 pip

Google CloudDatalab (Jupyter Notebook的原生)

Python jupyter notebook: https://zhuanlan.zhihu.com/p/33105153

http://localhost:8888/treelocalhost

[演練] 今天在Seaborn看到一張專業的圖，有Python Source code，想要在Anaconda Python使用。

(1) 哪一張Seaborn的圖？

Scatterplot with varying point sizes and hues — seaborn 0.13.2 documentationseaborn.pydata.org

(2) Source貼到Jupyter Notebook，可以嗎？ 不行！！！出錯了！！！什麼錯？

AttributeError: module 'seaborn' has .....-> seaborn這個套件版本不一致，這個版本的seaborn並沒有set_theme的function?怎麼辦？先槓掉...（不推薦)

用Pandas分析Excel資料

參考教材：https://drive.google.com/drive/folders/10I6TUMirjl4SKAKUC3PY1Yuw_YtKoAog?usp=sharing

[Pandas教學]5個實用的Pandas讀取Excel檔案資料技巧www.learncodewithmike.com

Read Excel with Python Pandas

18 Pandas Functions to Replace Excel with Python (and be happy forever) - JC ChouinardJC Chouinard

18 Pandas Functions to Replace Excel with Python (and be happy forever)

Reading and Writing Excel (XLSX) Files in Python with the Pandas LibraryStack Abuse

Reading and Writing Excel (XLSX) Files in Python with the Pandas Library

Common Excel Tasks Demonstrated in Pandaschris1610

Practical Business Python

Read Excel with Python Pandas - Python Tutorialpythonbasics.org

Read Excel with Python Pandas

使用 Python + Pandas 從包含多個工作表的 Excel 中擷取數據Medium

使用 Python + Pandas 從包含多個工作表的 Excel 中擷取數據

Word Cloud

Using custom colors — wordcloud 1.8.1 documentationamueller.github.io

在Pandas的DataFrame，通常會用df做變數名稱，就會用df去操作資料表，最後將運算好的結果寫回檔案。要統計銷售表中，州的銷售筆數？最好用圓餅圖呈現。

1. 先找個好看好用的python piechart套件 (https://docs.bokeh.org/en/latest/docs/gallery/pie_chart.html)

2. 參考sample code，找出資料的放置點 (x 變數，x變數是一個dict資料結構，<key,value>)

3. 要從df中抓出 state欄位的資料，然後計算state的出現次數(occurence)

   1. google keywords: python list count element dict

   2. https://stackoverflow.com/questions/3496518/using-a-dictionary-to-count-the-items-in-a-list (Collection的python套件，非常重要，有很多不錯的寫法）

python list count element dict

5/4 的範例程式 ipynb的格式存(iPython Notebook, jupyter notebook)

針對MacOS Log進行分析

Digital Forensics and Incident Response Training | SANS InstituteSANS Institute

Web access log (i.e., IIS, apache, tomcat..)

Using Python Pandas for Log AnalysisAkshay Ranganath’s Blogs

https://mmas.github.io/read-apache-access-log-pandas

Read Apache HTTP server access log with PandasModesto Mas | Blog

Analyzing Packet Captures with PythonThe vnetman blog

Blog - SpecterOpsSpecterOps

Part1~Part4

EvtxToElk: A Python Module to Load Windows Event Logs into ElasticSearch

https://www.dragos.com/blog/industry-news/evtxtoelk-a-python-module-to-load-windows-event-logs-into-elasticsearch/www.dragos.com

GitHub - tjnel/DSU_INSuRE_SP19_IDS_Prioritization: IDS Alert Prioritization INSuRE Research ProjectGitHub

GitHub - tjnel/DSU_INSuRE_SP19_IDS_Prioritization: IDS Alert Prioritization INSuRE Research ProjectGitHub

想當高手的，追蹤一下高手

https://github.com/tjnel