Nginx+uwsgi+Django 的web应用环境部署-完整记录
作者:互联网
Python作为当前最火爆最热门,也是最主要的Web开发语言之一,在其二十多年的历史中出现了数十种Web框架,比如Django、Tornado、Flask、Twisted、Bottle和Web.py等,它们有的历史悠久,有的发展迅速,还有的已经停止维护。Django是一个开放源代码的Web应用框架,由Python写成, 它作为Python重量级选手中最有代表性的一个Web框架, 许多成功的网站和APP都基于Django。
线上的web环境准备用Nginx+Django部署, 下面分别实现了Nginx+Django的http方式和Nginx+uwsgi+Django的sock方式 (并通过supervisor以守护进程方式管理uwsgi),在大并发情况下, 使用第二种方式性能会更好. 简单记录下操作过程:
一. Nginx+Django (http方式)
操作系统为Centos7.5 (本机ip为172.16.60.211) [root@web-node ~]# cat /etc/redhat-release CentOS Linux release 7.5.1804 (Core) 关闭防火墙和selinux [root@web-node ~]# systemctl disable firewalld [root@web-node ~]# systemctl stop firewalld [root@web-node ~]# setenforce 0 [root@web-node ~]# vim /etc/sysconfig/selinux SELINUX=disabled 1) 安装Python3.6.1 系统默认的是python2.7, 需要升级到Python3.6.1 ( 该Django项目跑在Python3.6.1版本下) [root@web-node ~]# python -V Python 2.7.5 下载并安装Python3.6.1 [root@web-node ~]# yum install -y gcc gcc-c++ [root@web-node ~]# yum -y install epel-release [root@web-node ~]# yum install zlib-devel bzip2-devel openssl-devel ncurses-devel sqlite-devel readline-devel tk-devel [root@web-node ~]# cd /usr/local/src/ [root@web-node src]# wget wget https://www.python.org/ftp/python/3.6.1/Python-3.6.1.tar.xz [root@web-node src]# tar xf Python-3.6.1.tar.xz [root@web-node src]# cd Python-3.6.1 [root@web-node Python-3.6.1]# ./configure --prefix=/usr/local/python3 [root@web-node Python-3.6.1]# make && make install 确认安装的Python下有pip3 [root@web-node Python-3.6.1]# ll /usr/local/python3/bin/python3 lrwxrwxrwx 1 root root 9 Dec 12 15:57 /usr/local/python3/bin/python3 -> python3.6 [root@web-node Python-3.6.1]# ll /usr/local/python3/bin/pip3 -rwxr-xr-x 1 root root 222 Dec 12 15:57 /usr/local/python3/bin/pip3 替换python [root@web-node Python-3.6.1]# cd /usr/bin [root@web-node bin]# mv python python.bak [root@web-node bin]# ln -s /usr/local/python3/bin/python3.6 /usr/bin/python [root@web-node bin]# python -V Python 3.6.1 设置系统环境变量 [root@web-node bin]# vim /etc/profile PATH=$PATH:/usr/local/python3/bin [root@web-node bin]# source /etc/profile 解决遗留问题 所有python相关的应用,如果使用/usr/bin/python开头的脚本,替换为/usr/bin/python2.7 [root@web-node ~]# vim /usr/bin/yum #!/usr/bin/python2.7 [root@web-node ~]# vim /usr/libexec/urlgrabber-ext-down #! /usr/bin/python2.7 2) 安装nginx [root@web-node ~]# useradd www [root@web-node ~]# cd /usr/local/src/ [root@web-node src]# wget http://10.0.8.50/software/nginx-1.12.2.tar.gz [root@web-node src]# tar -zvxf nginx-1.12.2.tar.gz [root@web-node src]# cd nginx-1.12.2 [root@web-node nginx-1.12.2]# ./configure --prefix=/usr/local/nginx --user=www --group=www --with-http_ssl_module --with-http_flv_module --with-http_stub_status_module --with-http_gzip_static_module --with-pcre --with-stream [root@web-node nginx-1.12.2]# make && make install 配置nginx [root@web-node nginx-1.12.2]# cd /usr/local/nginx/conf/ [root@web-node conf]# cp nginx.conf nginx.conf.bak [root@web-node conf]# > nginx.conf [root@web-node conf]# vim nginx.conf user www; worker_processes 4; #error_log logs/error.log; #error_log logs/error.log notice; #error_log logs/error.log info; #pid logs/nginx.pid; events { worker_connections 65535; } http { include mime.types; default_type application/octet-stream; charset utf-8; ###### ## set access log format ###### log_format main '$http_x_forwarded_for $remote_addr $remote_user [$time_local] "$request" ' '$status $body_bytes_sent "$http_referer" ' '"$http_user_agent" "$http_cookie" $host $request_time'; ####### ## http setting ####### sendfile on; tcp_nopush on; tcp_nodelay on; keepalive_timeout 65; proxy_cache_path /var/www/cache levels=1:2 keys_zone=mycache:20m max_size=2048m inactive=60m; proxy_temp_path /var/www/cache/tmp; fastcgi_connect_timeout 3000; fastcgi_send_timeout 3000; fastcgi_read_timeout 3000; fastcgi_buffer_size 256k; fastcgi_buffers 8 256k; fastcgi_busy_buffers_size 256k; fastcgi_temp_file_write_size 256k; fastcgi_intercept_errors on; # client_header_timeout 600s; client_body_timeout 600s; # client_max_body_size 50m; client_max_body_size 100m; client_body_buffer_size 256k; gzip on; gzip_min_length 1k; gzip_buffers 4 16k; gzip_http_version 1.1; gzip_comp_level 9; gzip_types text/plain application/x-javascript text/css application/xml text/javascript application/x-httpd-php; gzip_vary on; ## includes vhosts include vhosts/*.conf; } [root@web-node conf]# mkdir /usr/local/nginx/conf/vhosts [root@web-node conf]# mkdir -p /var/www/cache [root@web-node conf]# ulimit 65535 [root@web-node conf]# vim vhosts/ng.conf upstream py-8001 { ip_hash; server 127.0.0.1:8001 max_fails=3 fail_timeout=15s; server 127.0.0.1:8002 max_fails=3 fail_timeout=15s; } server { listen 80; server_name kevin.com www.kevin.com btc.kevin.com eth.kevin.com; access_log /usr/local/nginx/logs/8001-access.log main; error_log /usr/local/nginx/logs/8001-error.log; location / { proxy_pass http://py-8001; proxy_redirect off ; proxy_set_header Host $host; proxy_set_header X-Real-IP $remote_addr; proxy_set_header REMOTE-HOST $remote_addr; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; proxy_connect_timeout 300; proxy_send_timeout 300; proxy_read_timeout 600; proxy_buffer_size 256k; proxy_buffers 4 256k; proxy_busy_buffers_size 256k; proxy_temp_file_write_size 256k; proxy_next_upstream error timeout invalid_header http_500 http_502 http_503 http_504 http_404; proxy_max_temp_file_size 128m; #proxy_cache mycache; #proxy_cache_valid 200 302 1h; #proxy_cache_valid 301 1d; #proxy_cache_valid any 1m; } location /static/ { alias /data/www/APPServer/staticfiles/; } } 接着配置禁止ip访问, 只能通过域名访问 (vhosts下有很多域名的conf配置,那么只需要创建创建一个文件,比如deny.ip.conf,输入下面五行内容,这样就全局禁止了ip访问,只能使用域名访问了!)) [root@web-node ~]# cat /usr/local/nginx/conf/vhosts/deny.ip.conf server{ listen 80 default; server_name _; return 500; } 检查nginx配置文件是否正确 [root@r1014001 ~]# /usr/local/nginx/sbin/nginx -t nginx: the configuration file /usr/local/nginx/conf/nginx.conf syntax is ok nginx: configuration file /usr/local/nginx/conf/nginx.conf test is successful 这样nginx下就只能使用域名访问了, 使用ip访问的话, 就会出现"500 Internal Server Error"的信息, 即禁止ip访问! 3) 安装django (项目中使用的mysql是阿里云上的rds) [root@web-node ~]# yum install MySQL-python [root@web-node ~]# pip3 install Django==1.11 //最好使用pip3的全路径, 即"/usr/local/python3/bin/pip3 install Django==1.11", 否则可能会报错 [root@web-node ~]# pip3 install pymysql //最好使用pip3的全路径, 即"/usr/local/python3/bin/pip3 install pymysql", 否则可能会报错 django项目存放路径: /data/www/APPServer 静态页存放路径: /data/www/APPServer/staticfiles/ 静态页通过nginx访问展示(匹配static的路径), 动态页面通过nginx转发给python处理 将django项目代码拷贝到/data/www/APPServer 目录中 [root@web-node ~]# mkdir -p /data/www/APPServer/ [root@web-node ~]# chown -R www.www /data/www/APPServer [root@web-node ~]# cd /data/www/APPServer/ [root@web-node APPServer]# ls db.sqlite3 django_auth_example manage.py staticfiles templates users [root@web-node APPServer]# ls django_auth_example/ __init__.py __init__.pyc __pycache__ settings.py settings.pyc urls.py urls.pyc wsgi.py [root@web-node APPServer]# ll staticfiles/strategy/ total 1552 -rw-r--r-- 1 www www 51215 Dec 11 17:55 all.css -rw-r--r-- 1 www www 67742 Dec 11 17:55 bootstrap.bundle.min.js -rw-r--r-- 1 www www 144877 Dec 11 17:55 bootstrap.min.css -rw-r--r-- 1 www www 717611 Dec 11 17:55 echarts.min.js -rw-r--r-- 1 www www 31000 Dec 11 17:55 font-awesome.min.css -rw-r--r-- 1 www www 5187 Dec 11 17:55 index.js -rw-r--r-- 1 www www 86351 Dec 11 17:55 jquery-3.1.0.min.js -rw-r--r-- 1 www www 86927 Dec 11 17:55 jquery.min.js -rw-r--r-- 1 www www 721 Dec 11 17:55 main.css -rw-r--r-- 1 www www 0 Dec 11 17:55 main.js -rw-r--r-- 1 www www 5872 Dec 11 17:55 master.js -rw-r--r-- 1 www www 9662 Dec 11 17:55 tuzi.ico -rw-r--r-- 1 www www 351295 Dec 11 17:55 v3-4b631620.css 启动python程序, 由于是交互式的, 这里通过tmux终端复用工具 [root@web-node ~]# yum install tmux 编写python程序启动和关闭脚本 [root@web-node ~]# mkdir /data/script [root@web-node ~]# cd /data/script 启动脚本 (这里我启动了两个python程序进程, 并通过nginx进行代理转发, 将请求负载转发到这两个python端口上. 其实一台机器最好启动一个python进程, 多台机器启动多个python进程并通过nginx转发) [root@web-node script]# vim py_start.sh #!/bin/bash tmux new -d -s bobo_session && tmux send -t bobo_session 'python /data/www/APPServer/manage.py runserver 0.0.0.0:8001' ENTER tmux new -d -s bobo1_session && tmux send -t bobo1_session 'python /data/www/APPServer/manage.py runserver 0.0.0.0:8002' ENTER ================================================================================ 温馨提示: 上面的python程序启动时, 端口前面最好不要加ip了, 比如"/usr/local/python3/bin/python3 /data/www/APPServer/manage.py runserver 8001" 这样就只能通过nginx代理访问了, 即http://172.16.60.211, 使用http://172.16.60.211:8001和http://172.16.60.211:8002就不能访问了 ================================================================================ 关闭脚本 [root@web-node script]# vim py_stop.sh #!/bin/bash tmux kill-session -t bobo_session && tmux kill-session -t bobo1_session 授予脚本执行权限 [root@web-node script]# chmod 755 ./* [root@web-node script]# ll total 8 -rwxr-xr-x 1 root root 267 Dec 12 16:55 py_start.sh -rwxr-xr-x 1 root root 85 Dec 12 16:55 py_stop.sh 启动nginx和python程序 [root@web-node ~]# /usr/local/nginx/sbin/nginx -t nginx: the configuration file /usr/local/nginx/conf/nginx.conf syntax is ok nginx: configuration file /usr/local/nginx/conf/nginx.conf test is successful [root@web-node ~]# /usr/local/nginx/sbin/nginx [root@web-node ~]# sh /data/script/py_start.sh [root@web-node ~]# ps -ef|grep nginx root 1322 1 0 16:56 ? 00:00:00 nginx: master process /usr/local/nginx/sbin/nginx www 1323 1322 0 16:56 ? 00:00:00 nginx: worker process www 1324 1322 0 16:56 ? 00:00:00 nginx: worker process www 1325 1322 0 16:56 ? 00:00:00 nginx: worker process www 1326 1322 0 16:56 ? 00:00:00 nginx: worker process www 1327 1322 0 16:56 ? 00:00:00 nginx: cache manager process www 1328 1322 0 16:56 ? 00:00:00 nginx: cache loader process root 1397 12945 0 16:56 pts/0 00:00:00 grep --color=auto nginx [root@web-node ~]# ps -ef|grep manage www 1327 1322 0 16:56 ? 00:00:00 nginx: cache manager process root 1370 1341 3 16:56 pts/4 00:00:00 python /data/www/APPServer/manage.py runserver 0.0.0.0:8002 root 1371 1336 3 16:56 pts/2 00:00:00 python /data/www/APPServer/manage.py runserver 0.0.0.0:8001 root 1374 1370 6 16:56 pts/4 00:00:00 /usr/bin/python /data/www/APPServer/manage.py runserver 0.0.0.0:8002 root 1375 1371 5 16:56 pts/2 00:00:00 /usr/bin/python /data/www/APPServer/manage.py runserver 0.0.0.0:8001 root 1399 12945 0 16:56 pts/0 00:00:00 grep --color=auto manage [root@web-node ~]# lsof -i:80 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME nginx 1322 root 7u IPv4 68809825 0t0 TCP *:http (LISTEN) nginx 1323 www 7u IPv4 68809825 0t0 TCP *:http (LISTEN) nginx 1324 www 7u IPv4 68809825 0t0 TCP *:http (LISTEN) nginx 1325 www 7u IPv4 68809825 0t0 TCP *:http (LISTEN) nginx 1326 www 7u IPv4 68809825 0t0 TCP *:http (LISTEN) [root@web-node ~]# lsof -i:8001 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME python 1375 root 4u IPv4 68810914 0t0 TCP *:vcom-tunnel (LISTEN) [root@web-node ~]# lsof -i:8002 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME python 1374 root 4u IPv4 68811847 0t0 TCP *:teradataordbms (LISTEN) [root@web-node ~]# tmux ls bobo1_session: 1 windows (created Wed Dec 12 16:56:51 2018) [194x45] bobo_session: 1 windows (created Wed Dec 12 16:56:51 2018) [194x45] 最后将nginx配置文件中指定的域名kevin.com, www.kevin.com, btc.kevin.com, eth.kevin.com 解析到本机ip 然后输入http://www.kevin.com 即可访问django的web项目.
二. Nginx+uwsgi+Django (socker方式)
Django的部署可以有很多方式,采用nginx+uwsgi的方式是Django生产环境部署中比较常见的一种方式。
uwsgi介绍
uWSGI是一个Web服务器,它实现了WSGI协议、uwsgi、http等协议。Nginx中HttpUwsgiModule的作用是与uWSGI服务器进行交换。
这里一定要注意 WSGI , uwsgi , uWSGI 这三个概念的区分:
1) WSGI是一种Web服务器网关接口。它是一个Web服务器(如nginx,uWSGI等服务器)与web应用(如用Flask框架写的程序)通信的一种规范。
2) uwsgi是一种线路协议而不是通信协议,在此常用于在uWSGI服务器与其他网络服务器的数据通信。
3) uWSGI是实现了uwsgi和WSGI两种协议的Web服务器。
uwsgi协议是一个uWSGI服务器自有的协议,它用于定义传输信息的类型,每一个uwsgi packet前4byte为传输信息类型描述,它与WSGI相比是两样东西。uwsgi是一种线路协议而不是通信协议,在此常用于在uwsgi服务器与其他网络服务器的数据通信。uwsgi协议是一个uwsgi服务器自有的协议,它用于定义传输信息的类型。uwsgi实现了WSGI的所有接口,是一个快速、自我修复、开发人员和系统管理员友好的服务器。uwsgi代码完全用C编写,效率高、性能稳定。
uWSGI的主要特点如下
- 超快的性能;
- 低内存占用(实测为apache2的mod_wsgi的一半左右);
- 多app管理(终于不用冥思苦想下个app用哪个端口比较好了);
- 详尽的日志功能(可以用来分析app性能和瓶颈);
- 高度可定制(内存大小限制,服务一定次数后重启等);
uwsgi作用
Django 是一个 Web 框架,框架的作用在于处理 request 和 reponse,其他的不是框架所关心的内容。所以怎么部署 Django 不是 Django 所需要关心的。Django 所提供的是一个开发服务器,这个开发服务器,没有经过安全测试,而且使用的是 Python 自带的 simple HTTPServer 创建的,在安全性和效率上都是不行的而uwsgi 是一个全功能的 HTTP 服务器,他要做的就是把 HTTP 协议转化成语言支持的网络协议。比如把 HTTP 协议转化成 WSGI 协议,让 Python 可以直接使用。
uwsgi 是一种 uwsgi 的内部协议,使用二进制方式和其他应用程序进行通信。
总之uwsgi真的是一个好东西, 用起来性能非常高. 如果使用nginx+uwsgi方式, nginx作为反向代理,和uwsgi间通过http交互。配置nginx和uwsgi通过socket结合的方式。原理:用户发送http请求到nginx,nginx通过socket把请求交给uwsgi,uwsgi拿到django的处理结果,通过socket返还给nginx,nginx通过http返回结果给用户。操作如下:
安装uwsgi [root@web-node ~]# pip3 install uwsgi 编写测试 [root@web-node ~]# vim /root/test.py def application(env, start_response): start_response('200 OK', [('Content-Type','text/html')]) return [b"Hello World"] 启动测试 [root@web-node ~]# uwsgi --http :9009 --wsgi-file test.py 接着访问http://172.16.60.211:9009/ , 即可看到"Hello World"的访问信息. 下面开始nginx+uwsgi的配置 [root@web-node ~]# ll /usr/local/nginx/conf/uwsgi* -rw-r--r-- 1 root root 664 Dec 12 16:25 /usr/local/nginx/conf/uwsgi_params -rw-r--r-- 1 root root 664 Dec 12 16:25 /usr/local/nginx/conf/uwsgi_params.default 手动编写uwsgi.ini配置文件 (由于这里我启动了两个python程序, 即8001和8002端口, 所以这里要编写两个uwsgi配置文件) [root@web-node ~]# vim /usr/local/nginx/conf/uwsgi1.ini [uwsgi] #the local unix socket file than commnuincate to Nginx socket = 127.0.0.1:8001 # the base directory (full path) chdir = /data/www/APPServer # Django's wsgi file wsgi-file = django_auth_example/wsgi.py # maximum number of worker processes processes = 4 #thread numbers startched in each worker process threads = 2 [root@web-node ~]# vim /usr/local/nginx/conf/uwsgi2.ini [uwsgi] #the local unix socket file than commnuincate to Nginx socket = 127.0.0.1:8002 # the base directory (full path) chdir = /data/www/APPServer # Django's wsgi file wsgi-file = django_auth_example/wsgi.py # maximum number of worker processes processes = 4 #thread numbers startched in each worker process threads = 2 启动uwsgi (先关闭之前启动的python程序和nginx) [root@web-node ~]# sh /data/script/py_stop.sh [root@web-node ~]# /usr/local/nginx/sbin/nginx -s stop [root@web-node ~]# uwsgi /usr/local/nginx/conf/uwsgi1.ini [root@web-node ~]# uwsgi /usr/local/nginx/conf/uwsgi2.ini 由于uwsgi启动也是交互式, 所以还是需要用到tmux工具, 编写uwsgi启动和关闭脚本 uwsgi启动脚本 [root@web-node ~]# vim /data/script/uwsgi_start.sh #!/bin/bash tmux new -d -s bobo_session && tmux send -t bobo_session 'uwsgi /usr/local/nginx/conf/uwsgi1.ini' ENTER tmux new -d -s bobo1_session && tmux send -t bobo1_session 'uwsgi /usr/local/nginx/conf/uwsgi2.ini' ENTER uwsgi关闭脚本 [root@web-node ~]# vim /data/script/uwsgi_stop.sh #!/bin/bash tmux kill-session -t bobo_session && tmux kill-session -t bobo1_session ps -ef|grep uwsgi|grep -v grep|awk '{print $2}'|xargs kill -9 >/dev/null 2>&1 执行uwsgi启动 [root@web-node ~]# sh /data/script/uwsgi_start.sh [root@web-node ~]# tmux ls bobo1_session: 1 windows (created Wed Dec 12 22:49:49 2018) [136x29] bobo_session: 1 windows (created Wed Dec 12 22:49:49 2018) [136x29] [root@web-node ~]# lsof -i:8001 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME uwsgi 21161 root 3u IPv4 69341001 0t0 TCP localhost:vcom-tunnel (LISTEN) uwsgi 21165 root 3u IPv4 69341001 0t0 TCP localhost:vcom-tunnel (LISTEN) uwsgi 21166 root 3u IPv4 69341001 0t0 TCP localhost:vcom-tunnel (LISTEN) uwsgi 21167 root 3u IPv4 69341001 0t0 TCP localhost:vcom-tunnel (LISTEN) [root@web-node ~]# lsof -i:8002 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME uwsgi 21162 root 3u IPv4 69341406 0t0 TCP localhost:teradataordbms (LISTEN) uwsgi 21172 root 3u IPv4 69341406 0t0 TCP localhost:teradataordbms (LISTEN) uwsgi 21173 root 3u IPv4 69341406 0t0 TCP localhost:teradataordbms (LISTEN) uwsgi 21174 root 3u IPv4 69341406 0t0 TCP localhost:teradataordbms (LISTEN) [root@web-node ~]# ps -ef|grep uwsgi root 21161 21128 0 22:49 pts/1 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 21162 21135 0 22:49 pts/2 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 21165 21161 0 22:49 pts/1 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 21166 21161 0 22:49 pts/1 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 21167 21161 0 22:49 pts/1 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 21172 21162 0 22:49 pts/2 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 21173 21162 0 22:49 pts/2 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 21174 21162 0 22:49 pts/2 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 21231 18304 0 22:50 pts/0 00:00:00 grep --color=auto uwsgi 接着进行nginx+uwsgi配置 [root@web-node ~]# vim /usr/local/nginx/conf/vhosts/ng.conf upstream django { ip_hash; server 127.0.0.1:8001 max_fails=3 fail_timeout=15s; server 127.0.0.1:8002 max_fails=3 fail_timeout=15s; } server { listen 80; server_name kevin.com www.kevin.com btc.kevin.com eth.kevin.com; charset utf-8; access_log /usr/local/nginx/logs/8001-access.log main; error_log /usr/local/nginx/logs/8001-error.log; location / { uwsgi_pass django; include /usr/local/nginx/conf/uwsgi_params; } location /static/ { alias /data/www/APPServer/staticfiles/; } } 启动nginx [root@web-node ~]# /usr/local/nginx/sbin/nginx -t nginx: the configuration file /usr/local/nginx/conf/nginx.conf syntax is ok nginx: configuration file /usr/local/nginx/conf/nginx.conf test is successful [root@web-node ~]# /usr/local/nginx/sbin/nginx [root@web-node ~]# ps -ef|grep nginx root 21161 21128 0 22:49 pts/1 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 21162 21135 0 22:49 pts/2 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 21165 21161 0 22:49 pts/1 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 21166 21161 0 22:49 pts/1 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 21167 21161 0 22:49 pts/1 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 21172 21162 0 22:49 pts/2 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 21173 21162 0 22:49 pts/2 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 21174 21162 0 22:49 pts/2 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 21263 1 0 22:51 ? 00:00:00 nginx: master process /usr/local/nginx/sbin/nginx www 21264 21263 0 22:51 ? 00:00:00 nginx: worker process www 21265 21263 0 22:51 ? 00:00:00 nginx: worker process www 21266 21263 0 22:51 ? 00:00:00 nginx: worker process www 21267 21263 0 22:51 ? 00:00:00 nginx: worker process www 21268 21263 0 22:51 ? 00:00:00 nginx: cache manager process www 21269 21263 0 22:51 ? 00:00:00 nginx: cache loader process root 21271 18304 0 22:51 pts/0 00:00:00 grep --color=auto nginx [root@web-node ~]# lsof -i:80 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME nginx 21263 root 7u IPv4 69341986 0t0 TCP *:http (LISTEN) nginx 21264 www 7u IPv4 69341986 0t0 TCP *:http (LISTEN) nginx 21265 www 7u IPv4 69341986 0t0 TCP *:http (LISTEN) nginx 21266 www 7u IPv4 69341986 0t0 TCP *:http (LISTEN) nginx 21267 www 7u IPv4 69341986 0t0 TCP *:http (LISTEN) 最后输入http://www.kevin.com, 即可访问django的web项目
Supervisor管理uwsgi (守护进程模式)
由于直接执行uwsgi是交互式的, 所以上面使用了tmux终端复用工具, 如果不使用tmux, 则可以使用supervisor, 使用supervisor管理uwsgi, 为了让它后台运行,需要让它变成守护进程。supervisor的使用可以参考: https://www.cnblogs.com/kevingrace/p/7525200.html . 以下是supervisor的安装和管理记录:
1) 安装supervisor [root@web-node ~]# pip3 install supervisor 会遇到如下报错信息: Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-build-ns8sn4n6/supervisor/ You are using pip version 9.0.1, however version 18.1 is available. You should consider upgrading via the 'pip install --upgrade pip' command. 这是因为supervisor不支持python3, pip3使用的是python3.6.1版本 [root@web-node ~]# python -V Python 3.6.1 1.1) 安装pyenv 为了使用supervisor,我们需要python2.7的环境。而多版本python的管理,推荐使用pyenv。 安装pyenv套装 [root@web-node ~]# curl -L https://raw.githubusercontent.com/pyenv/pyenv-installer/master/bin/pyenv-installer | bash 内容除了包含 pyenv 以外,还包含如下插件: - pyenv-doctor - pyenv-installer - pyenv-update - pyenv-virtualenv - pyenv-which-ext ========================================================= 温馨提示: 以上https://raw.githubusercontent.com/pyenv/pyenv-installer/master/bin/pyenv-installer的访问内容 , 可以将内容粘出来放在服务器的一个shell脚本文件中, 然后执行该脚本用以安装pyenv 该脚本的百度下载地址: https://pan.baidu.com/s/1wW9ylrmc4Q9wxu_i3-1wYA 提取密码: rhtj 执行脚本进行安装(执行前授予755权限) # chmod 755 pyenv-installer # /bin/bash pyenv-installer ========================================================= 路径添加 [root@web-node ~]# ll -d /root/.pyenv drwxr-xr-x 11 root root 331 Dec 13 10:08 /root/.pyenv [root@web-node ~]# vim ~/.bash_profile //添加下面内容 export PATH="/root/.pyenv/bin:$PATH" eval "$(pyenv init -)" eval "$(pyenv virtualenv-init -)" 使之生效 [root@web-node ~]# source ~/.bash_profile 查看安装情况 [root@web-node ~]# pyenv -v pyenv 1.2.8 常用命令 - 查看可安装的python版本列表:pyenv install -l - 安装指定版本的python:pyenv install 2.7.3 - 查看已安装的python:pyenv versions - 查看当前设为默认的python版本:pyenv version 1.2) 安装python2.7环境 pyenv安装指定版本的python [root@web-node python]# pyenv install 2.7.13 Installing Python-2.7.13... Installed Python-2.7.13 to /root/.pyenv/versions/2.7.13 [root@web-node ~]# /root/.pyenv/versions/2.7.13/bin/python2.7 -V Python 2.7.13 查看pyenv已安装的python [root@web-node ~]# pyenv versions system * 2.7.13 (set by /root/.pyenv/version) 2.7.13/envs/supervisor 查看当前pyenv设为默认的python版本 [root@web-node ~]# pyenv version 2.7.13 (set by /root/.pyenv/version) 1.3) 安装虚拟环境 新建supervisor虚拟环境 [root@web-node ~]# pyenv virtualenv 2.7.13 supervisor 激活虚拟环境 [root@web-node ~]# source /root/.pyenv/versions/2.7.13/envs/supervisor/bin/activate supervisor (supervisor) [root@web-node ~]# 或者 (supervisor) [root@web-node ~]# source activate supervisor (supervisor) [root@web-node ~]# 安装supervisor (supervisor) [root@web-node ~]# yum install supervisor (supervisor) [root@web-node ~]# pip install supervisor 生成配置文件 (supervisor) [root@web-node ~]# mkdir -p /etc/supervisor/ (supervisor) [root@web-node ~]# echo_supervisord_conf > /etc/supervisord.conf 修改配置文件 (文件最底行添加下面内容) (supervisor) [root@web-node ~]# vim /etc/supervisord.conf [include] files = /etc/supervisor/*.conf 运行 (supervisor) [root@web-node ~]# /root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisord -c /etc/supervisord.conf (supervisor) [root@web-node ~]# ps -ef|grep supervisord root 30765 1 0 10:57 ? 00:00:00 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/python2.7 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisord -c /etc/supervisord.conf root 30798 10184 0 10:57 pts/1 00:00:00 grep --color=auto supervisord 1.4) 编辑supervisord.service (supervisor) [root@web-node ~]# cp /usr/lib/systemd/system/supervisord.service /usr/lib/systemd/system/supervisord.service.bak (supervisor) [root@web-node ~]# vim /usr/lib/systemd/system/supervisord.service //内容修改为(之前的内容清空, 复制下面的内容) [Unit] Description=Process Monitoring and Control Daemon After=rc-local.service nss-user-lookup.target [Service] Type=forking ExecStart=/root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisord -c /etc/supervisord.conf ExecReload=/root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisorctl reload ExecStop=/root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisorctl shutdown [Install] WantedBy=multi-user.target 1.5) 重启supervisor (多测试几次) (supervisor) [root@web-node ~]# ps aux | grep supervisord root 31663 0.0 0.1 215176 13856 ? Ss 11:03 0:00 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/python2.7 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisord -c /etc/supervisord.conf root 31781 0.0 0.0 112704 976 pts/1 S+ 11:03 0:00 grep --color=auto supervisord 由于上面的supervisord进程是使用配置文件手动启动的, 首次要使用下面的命令关闭,然后使用"systemctl start/stop supervisord" 才会生效 如果第一次不使用下面命令关闭, 而首次就使用"systemctl stop supervisord" 则关闭不了. (supervisor) [root@web-node ~]# /root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisorctl shutdown Shut down (supervisor) [root@web-node ~]# ps aux | grep supervisord root 31857 0.0 0.0 112704 972 pts/1 S+ 11:04 0:00 grep --color=auto supervisord (supervisor) [root@web-node ~]# systemctl start supervisord (supervisor) [root@web-node ~]# ps aux | grep supervisord root 31892 0.0 0.1 217312 13872 ? Ss 11:04 0:00 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/python2.7 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisord -c /etc/supervisord.conf root 31919 0.0 0.0 112704 972 pts/1 S+ 11:04 0:00 grep --color=auto supervisord (supervisor) [root@web-node ~]# systemctl stop supervisord (supervisor) [root@web-node ~]# ps aux | grep supervisord root 31986 0.0 0.0 112704 976 pts/1 S+ 11:04 0:00 grep --color=auto supervisord (supervisor) [root@web-node ~]# systemctl start supervisord (supervisor) [root@web-node ~]# ps aux | grep supervisord root 32037 0.0 0.1 217312 13868 ? Ss 11:04 0:00 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/python2.7 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisord -c /etc/supervisord.conf root 32064 0.0 0.0 112704 976 pts/1 S+ 11:04 0:00 grep --color=auto supervisord 1.6) 设置开机启动 (supervisor) [root@web-node ~]# systemctl enable supervisord Created symlink from /etc/systemd/system/multi-user.target.wants/supervisord.service to /usr/lib/systemd/system/supervisord.service. 2) 守护uwsgi 先关闭之前使用tmux启动的uwsgi进程 (supervisor) [root@web-node ~]# ps -ef|grep uwsgi root 29088 29055 0 00:53 pts/4 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 29089 29061 0 00:53 pts/5 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 29092 29089 0 00:53 pts/5 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 29093 29089 0 00:53 pts/5 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 29094 29089 0 00:53 pts/5 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi2.ini root 29098 29088 0 00:53 pts/4 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 29099 29088 0 00:53 pts/4 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 29100 29088 0 00:53 pts/4 00:00:00 uwsgi /usr/local/nginx/conf/uwsgi1.ini root 32579 10184 0 11:09 pts/1 00:00:00 grep --color=auto uwsgi (supervisor) [root@web-node ~]# tmux ls bobo1_session: 1 windows (created Thu Dec 13 00:53:19 2018) [136x29] bobo_session: 1 windows (created Thu Dec 13 00:53:19 2018) [136x29] (supervisor) [root@web-node ~]# sh /data/script/uwsgi_stop.sh Killed (supervisor) [root@web-node ~]# ps -ef|grep uwsgi root 32689 10184 0 11:09 pts/1 00:00:00 grep --color=auto uwsgi (supervisor) [root@web-node ~]# tmux ls failed to connect to server 2.1) 配置supervisor, 以守护进程方式管理uwsgi 先关闭上面启动的supervisord (supervisor) [root@web-node supervisor]# systemctl stop supervisord (supervisor) [root@web-node supervisor]# ps aux | grep supervisord root 2467 0.0 0.0 112704 972 pts/1 S+ 11:27 0:00 grep --color=auto supervisord 因为nginx和uwsgi通过socket方式交互,所以需要修改uwsgi.ini的配置为: (supervisor) [root@web-node supervisor]# cd /usr/local/nginx/conf/ (supervisor) [root@web-node conf]# cp uwsgi1.ini uwsgi1.ini.bak (supervisor) [root@web-node conf]# cp uwsgi2.ini uwsgi2.ini.bak (supervisor) [root@web-node conf]# vim uwsgi1.ini [uwsgi] socket = :8001 chdir = /data/www/APPServer wsgi-file = django_auth_example/wsgi.py static-map = '/static=static' master = true processes = 2 enable-threads = true (supervisor) [root@web-node conf]# vim uwsgi2.ini [uwsgi] socket = :8002 chdir = /data/www/APPServer wsgi-file = django_auth_example/wsgi.py static-map = '/static=static' master = true processes = 2 enable-threads = true 接着在/etc/supervisor中新建文件bobo.conf和bobo1.conf(这里启动了两个端口, 所以也要配置两个) (supervisor) [root@web-node supervisor]# vim bobo.conf [program:bobo] command=/usr/local/python3/bin/uwsgi /usr/local/nginx/conf/uwsgi1.ini directory=/usr/local/nginx/conf/ startsecs=0 stopwaitsecs=0 autostart=true autorestart=true (supervisor) [root@web-node supervisor]# vim bobo1.conf [program:bobo1] command=/usr/local/python3/bin/uwsgi /usr/local/nginx/conf/uwsgi2.ini directory=/usr/local/nginx/conf/ startsecs=0 stopwaitsecs=0 autostart=true autorestart=true 重启supervisor (supervisor) [root@web-node supervisor]# ps aux | grep supervisord root 5177 0.0 0.0 112704 972 pts/1 S+ 11:47 0:00 grep --color=auto supervisord (supervisor) [root@web-node supervisor]# systemctl start supervisord (supervisor) [root@web-node supervisor]# ps aux | grep supervisord root 5218 0.0 0.1 217568 14104 ? Ss 11:47 0:00 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/python2.7 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisord -c /etc/supervisord.conf root 5253 0.0 0.0 112704 972 pts/1 S+ 11:47 0:00 grep --color=auto supervisord (supervisor) [root@web-node supervisor]# systemctl status supervisord ● supervisord.service - Process Monitoring and Control Daemon Loaded: loaded (/usr/lib/systemd/system/supervisord.service; enabled; vendor preset: disabled) Active: active (running) since Thu 2018-12-13 13:35:46 CST; 26s ago Process: 11883 ExecStop=/root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisorctl shutdown (code=exited, status=0/SUCCESS) Process: 12681 ExecStart=/root/.pyenv/versions/2.7.13/envs/supervisor/bin/supervisord -c /etc/supervisord.conf (code=exited, status=0/SUCCESS) Main PID: 12684 (supervisord) CGroup: /system.slice/supervisord.service ├─12684 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/python2.7 /root/.pyenv/versions/2.7.13/envs/supervisor/bin/superv... ├─12717 /usr/local/python3/bin/uwsgi /usr/local/nginx/conf/uwsgi1.ini ├─12718 /usr/local/python3/bin/uwsgi /usr/local/nginx/conf/uwsgi2.ini ├─12721 /usr/local/python3/bin/uwsgi /usr/local/nginx/conf/uwsgi1.ini ├─12722 /usr/local/python3/bin/uwsgi /usr/local/nginx/conf/uwsgi1.ini ├─12723 /usr/local/python3/bin/uwsgi /usr/local/nginx/conf/uwsgi2.ini └─12724 /usr/local/python3/bin/uwsgi /usr/local/nginx/conf/uwsgi2.ini Dec 13 13:35:46 web-node systemd[1]: Starting Process Monitoring and Control Daemon... Dec 13 13:35:46 web-node systemd[1]: Started Process Monitoring and Control Daemon. Warning: supervisord.service changed on disk. Run 'systemctl daemon-reload' to reload units. (supervisor) [root@web-node supervisor]# lsof -i:8001 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME uwsgi 5244 root 3u IPv4 70530592 0t0 TCP *:vcom-tunnel (LISTEN) uwsgi 5250 root 3u IPv4 70530592 0t0 TCP *:vcom-tunnel (LISTEN) uwsgi 5251 root 3u IPv4 70530592 0t0 TCP *:vcom-tunnel (LISTEN) (supervisor) [root@web-node supervisor]# lsof -i:8002 COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME uwsgi 5245 root 3u IPv4 70531513 0t0 TCP *:teradataordbms (LISTEN) uwsgi 5248 root 3u IPv4 70531513 0t0 TCP *:teradataordbms (LISTEN) uwsgi 5249 root 3u IPv4 70531513 0t0 TCP *:teradataordbms (LISTEN) ======================================================== 附带温馨提示 直接重启supervisor项目bobo和项目bobo1的命令 (supervisor) [root@web-node supervisor]# supervisorctl -c /etc/supervisord.conf restart bobo bobo: stopped bobo: started (supervisor) [root@web-node supervisor]# supervisorctl -c /etc/supervisord.conf restart bobo1 bobo1: stopped bobo1: started ======================================================== 上面在nginx中vhosts/ng.conf文件中配置的转发关系不用修改. 需要知道的事: 此时django项目中的的静态资源并不是通过uwsgi获取, 而是通过nginx直接获取的(匹配static的path路径访问静态资源) 此时输入http://www.kevin.com, 即可访问django的web项目! 最后退出supervisor环境 (supervisor) [root@web-node supervisor]# source deactivate pyenv-virtualenv: deactivate 2.7.13/envs/supervisor [root@web-node supervisor]# 退出supervisor环境后, uwsgi守护进程并没有受到影响。 再次进入supervisor环境 [root@web-node supervisor]# source activate supervisor pyenv-virtualenv: activate supervisor pyenv-virtualenv: prompt changing will be removed from future release. configure `export PYENV_VIRTUALENV_DISABLE_PROMPT=1' to simulate the behavior. (supervisor) [root@web-node supervisor]#
标签:node,web,00,Django,nginx,uwsgi,root,应用环境 来源: https://blog.51cto.com/u_10272167/2705138