国内的Python 量化交易工具
之前也在网上看到贴子有人通过IBM SPSS、pspp这类专业的统计学计算工具对采票号码进行统计计算后，进行概率分析 ，进而投注，一年赚了几万块。姑且不考虑这个故事的真实性。不过最近在知乎上又看到类似的励志故事，这里摘录了过来－－－科学家有了钱以后,真是挺吓人的。提了这两个引子，进入……
科学家有了钱以后,真是挺吓人的
计算化学领域中有哪些技术可以被称为是当前的黑科技？ 要讲这个黑科技，我们可能要扯远一点，先讲讲 D.E. Shaw 这个人是怎么学术赚钱通吃，成为彻底的赢家。 D.E.Shaw 是个学霸，是 PhD 们的偶像：斯坦福大学计算机专业的博士, 30 岁不到就进入哥伦比亚大学做教授，专门研究超大规模并行计算。这已经是优秀的学术人生了。 但……
Google 镜像站搜集
依旧是google被墙的问题，查看个google就需要翻墙。这里收集一部分google镜像站点 ，用于解决google站点无法正常访问的问题。镜像站分原版和非原版，非原版界面有些改变，搜索结果依然是相同的。 <a href="https://blog.361way.com/wp-content/uploads/2015/06/google-mirror.png"><img src="https://blog.361way.com/wp-content/uploads/2015/06/google-mirror-300x98.png" alt="google-mirror" width="300" height="98" class="alignnone size-medium wp-image-4550" /></a> 本文将不定期维护更新，删除不能用的，增加新的可用网址。欢……
open-falcon agent安装使用
open-falcon agent项目之前是一个独立项目名字叫falcon-eye ，其自带有web页面来自于linux-dash项目。agent用于采集机器负载监控指标，比如cpu.idle、load.1min、disk.io.util等等，每隔60秒push给Transfer。agent与Trans……
Golang的安装
做为运维人员，使用python语言足矣，理论上是无需了解golang的。不过最近发现一个新潮的监控系统都是基于golang进行开发的，如小米公司的Open-Falcon（github项目页） 、stack exchange 公司的Bosun （github项目页）。 一、Go的三种安装方式 Go有多种安装……
fastcgi_cache with conditional purging
Check if your nginx has fastcgi_cache_purge module Support for fastcgi_cache_purge should be already there. You can test it by running following command:
1nginx -V 2>&1 | grep nginx-cache-purge -o If you see nginx-cache-purge in output then you already have it.
Otherwise, if you are on Ubuntu with default Nginx installation, you can run following commands to install nginx with fastcgi_cache_purge module.
Reinstall nginx with fastcgi_cache purge module support 1sudo add-apt-repository ppa:rtcamp/nginx 2sudo apt-get update 3sudo apt-get remove nginx* 4sudo apt-get install nginx-custom Install Nginx Helper Plugin Above step ensures that Nginx can purge a page from its fastcgi_cache selectively. But Nginx cannot automatically find out which page to purge and when to purge?
So install Nginx helper plugin from WordPress plugin repository and activate it. Apart from other features, it provides cache purging options. Just activate it, go to its settings and turn on “Enable Cache Purge” option.……
Crawl a website with scrapy
Introduction In this article, we are going to see how to scrape information from a website, in particular, from all pages with a common URL pattern. We will see how to do that with Scrapy, a very powerful, and yet simple, scraping and web-crawling framework. For example, you might be interested in scraping information about each article of a blog, and store it information in a database. To achieve such a thing, we will see how to implement a simple spider using Scrapy, which will crawl the blog and store the extracted data into a MongoDB database. We will consider that you have a working MongoDB server, and that you have installed thepymongoandscrapypython packages, both installable with pip. If you have never toyed around with Scrapy, you should first read this short tutorial. First step, identify the URL pattern(s) In……
linux-dash web监控系统的安装
Linux-dash是一款为Linux设计的基于Web的轻量级监控面板。这个程序会实时显示各种不同的系统属性，比如CPU负载、RAM使用率、磁盘使用率、网速、网络连接、RX/TX带宽、登录用户、运行的进程等等。它不会存储长期的统计。因为它没有后端数据库。其支持PHP, Node.js, Go 做为we……
Communicating with RESTful APIs in Python
REST defines a way to design an API with which you can consume its ressources using HTTP methods (GET, POST, etc) over URLs. Interacting with such an API basically comes down to sending HTTP requests. In this article, we’ll see which python modules are available to solve this problem, and which one you should use. We’ll test all modules with this simple test case: we would like to create a new Github repository using their RESTful API. Python and HTTP: too many modules One known problem with Python is the abundance of modules enabling HTTP communication: urllib2 httplib httplib2 pycurl requests If you’re totally new to Python, this might be confusing, so let me try to clarify things a little bit. First things first: httplib will not……
IBM 刀片大量DHCPREQUEST输出处理
一、现象 现网的一台主机，今天收到宕机告警，经登录查看主机未宕机，只不过ssh当时连接被拒。查看/var/log/message日志，发现有大量的DHCPREQUEST请求日志。具体内容如下： 1[root@datanode2 init.d]# tail -f /var/log/messages 2Jun 1 16:51:09 datanode2 dhclient: bound to 169.254.95.120 -- renewal in 280 seconds. 3Jun 1 16:55:49 datanode2 dhclient: DHCPREQUEST on usb0 to 169.254.95.118 port 67 (xid=0x691bb32a) 4Jun 1 16:55:49 datanode2 dhclient: DHCPACK from 169.254.95.118 (xid=0x691bb32a) 5Jun 1 16:55:49 datanode2 dhclient:……