[研討會心得]PyCon APAC 2014 05/18 Day2 Note

May 18th, 2014

Keynote: Jessica McKellar

R2 What Is Async, How Does It Work, and When Should I Use It?

A. Jesse Jiryu Davis http://emptysqua.re/blog/ https://twitter.com/jessejiryudavis

StreetVoice 改造後, 現在我們如何進行開發工作

http://tzangms.com/

  • StreetVoice

    • SimpleLife

  • Old street voice

    • windows + ASP 

    • no version control

  • New Street voice

    • Python + Django

    • MariaDB

    • redis

    • RabbitMQ

    • Git/Github

  • What changes

    • unit test

    • travis 

    • error tracking

    • sentry for JS/python

      • can use sentry for github issues.

    • deployment

    • saltstack

      • use one command line to push to all servers

    • hubot https://hubot.github.com/

    • hipchar -> hubot -> saltstack

      • using chat message to control deployment

  • Make it all together  — Hipchat

    • hipchat

    • error -> hipchat

    • Github update -> hipchat

  • github branch strategy

    • default — develop

    • When it done -> product branch

    • Implement new -> feature branch

  • Github submit flow

    • pull request

    • travis (unit test)

    • push back result on hipchat

  • Open Source Projects

  • Resource:

    • 工作流程: trello, github

    •   - 即時討論: hipchat

    •   - 錯誤追蹤: sentry

    •   - 單元測試: 使用 travis / coveralls, 搭配  pip wheels

    •     - 如何提升? 每週五衝 unit test, 在兩個月內衝了 10% coverage

    •   - 部署: saltstack + hubot

    •     我們有北京 + 台灣 + AWS 機房

    •   - 趣味: hubot

    •   - 現在我們持續開源:

    •     - ididit:  idonethis clone

    •     - django-celery-ses: Django Email Backend + SES + Celery

    •     - HysteriaPlayer: Streaming media player for iOS

如何用 grs 擷取台灣上市股票股價資訊 @toomore

http://www.toomore.net/

  • Why use python

    • Excel has limitation 65536

    • 81 days only 

  • 股票分析網站

    • 消息類

    • 注意與收集相關個股消息

    • 技術類

    • 看線圖的價跟量

  • grs

    • 本身偏技術分析

    • Install and using

    • pip install grs

    • from grs import Stock

    • stock(‘2618).info

    • grs-doc

    • it has version control, different version have diff doc

  • 簡單分析

    • 均價/均量

    • (Stock.MA, Sock.MAV)

    • 五日均價  Stock(‘2618’).MA(‘5’)

    • 均價乖離

    • Stock.MAO 

    • 乖離轉折點

    • Stock(‘2618).MAO

    • 四大買賣判斷

    • BestFourPoint

    • 買(賣)點

      • 負 (正) : 乖離扣至最大 量大收紅 (黑)

      • 負 (正) : 乖離扣至最大 量縮價不跌(跌)

      • 短期日 3/6/18 日 ～比起市場 5/20/60 日提早是因為想要更早看出線圖

    • from grs import BestFourPoint

  • 其他常用工具

    • 顯示台灣時間  TWTime

    • 是否開市  TWSEOpen

    • 個股即時盤  RealtimeStock

    • 大盤即時資訊  Realtimeeight

    • 上市～上櫃代碼 TWSENo OTCNo

    • 單日倒數時間 Countdown

  • 其他利用工具

    • XMPP rubot

    • using XMPP with grs+GAE

  • Resource

Rapid Web Development with Mezzanine Stephen McDonald

  https://pyconapac2014.hackpad.com/Keynote-Stephen-McDonald-day2-x4HpfSvNc1f

  • Why another CMS?

    • People do awesome job in marketing but don’t have good technical skills to back it up.

    • Try to abstract out the logic to make things reusable without copy-pasting.

  • ”You make different things if you focus on constraints instead of requirements.” — Benjamin Black (@b6n)

  • Mezzanine i

    • Constraints

    • Simplicity

    • Just Django

  • Model graph http://bit.ly/MezzLego

  • About Mezanine

    • class RichTextPAge(Page)

    • class Form(Page)

    • class Gallery(Page)

    • It is very easy to implement blog/shopping cart/gallery 

  • About Batteries included in Mezzanine

    • Python and Django is good ecosystem to provide more “power”

    • batteries include

    • Keywords, rating, threaded comments

    • search 

    • user editable setting

    • Multi-tenancy 

    • image thubnailing

    • caching

    • bootstrap + live edting

    • deploy tooling

  • Extra Batteries

  • Other ~70 packages

  • Resource:

Functional Programming in Python

https://pyconapac2014.hackpad.com/Functional-Programming-in-Python-101-nvp9OVl6NPz

http://www.slideshare.net/littleq0903/functional-programming-in-python-33358806

以廣告品項為基礎的行動廣告推薦系統: 以 Python Hadoop Streaming 實作

  • Mobile Advertise System

    • Impression AD

    • Banner, Or any kind of AD in mobile system

    • Conversion

    • 到定點列印QR code 去兌換東西

    • Landing pages

    • 可以顯示廣告接受人與店家的距離

  • 行動廣告重要數據

    • Click Through Rate (CTR)  每一百次顯示有多少點擊次數

    • Conversion Rate 產生的實際行為

    • Goal:

    • Maximum CTR and conversations

  • Architect

    • Http Host

    • DB: Couch DB (NoSQL)

    • In memory grid for realtime backend process.

    • Hadoop distributed + spark + HBase

    • Web

    • Django + SSH

    • AD video, image

    • CDS

    • Message Queue

    • Ad Operation

    • Reporting Operation
  • Data Selection -> Machine Learning -> Prediction -> Evaluation (for machine learning adjustment)

High Performance Tool with Python

Andreas Klöckner 

  • Scripting language are SLOW

  • Let computing in OpenCL other using Python

  • OpenCL

    • JIT build kernel

  • Moving Data

    • Latency

    • Higher Current (more power)

  • Programing Model need modification to adopt concurrency Parallelism

  • Parallel Programming 

  • PyOpenCL

    • Benefit in just use OpenCL

    • PyOpenCl will compile and cache the kernel code for you.

    • Auto cleanup

    • Error Checking

  • Machine generate code (code generation)

    • Using PyOpenCL could generate kernel by using some function packages

    • Let machine generate OpenCL kernel code for you.

    • Automated tuning

    • data types 

    • specialize code for given problem

    • constants faster than variables

    • Loop unrooling

  • Scan problem (input need last output)

    • 1 , 1, 2, (1+1+2) 4, (1+1+2+4) 8

    • Using GenericScan in OpenCL you don’t need write any kernel code here.

  • Loop Generation 

    • c[i, j] = a[i] * b[j]

    • It is very hard for OpenCL to do it because it need other input

  • Bonus Features

    • A-priori bounds checking

    • Generate a sequential version of code

    • Automatic Benchmarking

    • Free tuning advice

    • Local memory layout

    • Automatic Testing

    • Data layout transformation

  • loo.py

    • Will be MIT, release in summer
  •  http://andreask.cs.illinois.edu/aboutme/
Buy Me A Coffee

Evan

Attitude is everything