江湖救急, nginx+webpy+fastcgi模式, 多線程模式會服務(wù)掛起不響應(yīng)

isnowran

這個問題折騰了好久, 都想換框架了, 但webpy實在用順手了, 請眾位大神幫忙看看
python fastcgi 代碼:

1. 
   
2. #!/usr/local/bin/python2.7
   
3. 
   
4. import web
   
5. 
   
6. class version(object):
   
7.     def GET(self, v):
   
8.         print "in"
   
9.         return "0.1.2"
   
10. 
    
11. urls = ('/(.*)', 'version')
    
12. 
    
13. if __name__ == "__main__":
    
14.     web.config.debug = False
    
15.     app = web.application(urls, globals())
    
16.     app.run()
    

復制代碼

運行

1. 
   
2. [binary@APP src]$ ./run.py fcgi 9002
   

復制代碼

nginx檢查:

1. 
   
2. [root@APP ~]# nginx -t
   
3. nginx: the configuration file /usr/local/nginx/conf/nginx.conf syntax is ok
   
4. nginx: configuration file /usr/local/nginx/conf/nginx.conf test is successful
   

復制代碼

nginx配置:

1. 
   
2. [root@APP ~]# cat /usr/local/nginx/conf/nginx.conf
   
3. worker_processes  1;
   
4. 
   
5. events {
   
6.     worker_connections  1024;
   
7.     use epoll;
   
8. }
   
9. 
   
10. http {
    
11.     include       mime.types;
    
12.     default_type  application/octet-stream;
    
13. 
    
14.     sendfile        on;
    
15. 
    
16.     keepalive_timeout  65;
    
17. 
    
18.     server {
    
19.         listen       80;
    
20.         server_name  localhost;
    
21. 
    
22.         location / {
    
23.             root   html;
    
24.             index  index.html index.htm;
    
25.             include fastcgi_params;
    
26.                 fastcgi_param REQUEST_METHOD $request_method;
    
27.                 fastcgi_param QUERY_STRING $query_string;
    
28.                 fastcgi_param CONTENT_TYPE $content_type;
    
29.                 fastcgi_param CONTENT_LENGTH $content_length;
    
30.                 fastcgi_param GATEWAY_INTERFACE CGI/1.1;
    
31.                 fastcgi_param SERVER_SOFTWARE nginx/$nginx_version;
    
32.                 fastcgi_param REMOTE_ADDR $remote_addr;
    
33.                 fastcgi_param REMOTE_PORT $remote_port;
    
34.                 fastcgi_param SERVER_ADDR $server_addr;
    
35.                 fastcgi_param SERVER_PORT $server_port;
    
36.                 fastcgi_param SERVER_NAME $server_name;
    
37.                 fastcgi_param SERVER_PROTOCOL $server_protocol;
    
38.                 fastcgi_param SCRIPT_FILENAME $fastcgi_script_name;
    
39.                 fastcgi_param PATH_INFO $fastcgi_script_name;
    
40.                 fastcgi_pass 127.0.0.1:9002;
    
41.         }
    
42. 
    
43.         error_page   500 502 503 504  /50x.html;
    
44.         location = /50x.html {
    
45.             root   html;
    
46.         }
    
47.     }
    
48. }
    
49. [root@APP ~]#
    

復制代碼

第一次請求測試:

1. 
   
2. [root@APP ~]# curl http://127.0.0.1/
   
3. 0.1.2
   

復制代碼

ab1000個并發(fā)測試:

1. 
   
2. [root@APP ~]# ab -c1000 -n 1000 http://127.0.0.1/      
   
3. This is ApacheBench, Version 2.3 <$Revision: 655654 $>
   
4. Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
   
5. Licensed to The Apache Software Foundation, http://www.apache.org/
   
6. 
   
7. Benchmarking 127.0.0.1 (be patient)
   
8. apr_socket_recv: Connection reset by peer (104)
   
9. Total of 32 requests completed
   

復制代碼

再次請求測試, 就卡死了, 但是, fcgi能打印出"in":

1. 
   
2. [root@APP ~]# curl http://127.0.0.1/
   

復制代碼

重啟nginx沒用, 必須重啟fastcgi

為了排除是nginx的問題, 我又用c做fastcgi測試, 就沒有問題, 無論并發(fā)有多大, 都不會造成無響應(yīng), 代碼如下:

1. 
   
2. [binary@APP src]$ cat cgi.cpp
   
3. #include <iostream>
   
4. #include <fcgi_stdio.h>
   
5. #include <stdlib.h>
   
6. #include <stdio.h>
   
7. 
   
8. using namespace std;
   
9. 
   
10. int main ()
    
11. {
    
12.         int count = 0;
    
13. 
    
14.         while (FCGI_Accept () >= 0)
    
15.         {
    
16. 
    
17.                 printf ("Content-type:text/html\r\n\r\n");
    
18.                 printf ("<p> Hello FastCGI !  </ p>");
    
19.                 printf ("<br /> Request number = [%d]", ++count);
    
20.                 printf ("<br /> Process ID: %d ", getpid ());
    
21.         }
    
22. 
    
23.         return 0;
    
24. }
    

復制代碼

各個組件版本, nginx:1.63. webpy:0.3.7:

1. 
   
2. [binary@APP src]$ nginx -v  
   
3. nginx version: nginx/1.6.3
   
4. [binary@APP src]$
   

復制代碼

1. 
   
2. NAME
   
3.     web - web.py: makes web apps (http://webpy.org)
   
4. 
   
5. FILE
   
6.     /usr/local/lib/python2.7/site-packages/web/__init__.py
   
7. 
   
8. PACKAGE CONTENTS
   
9.     application
   
10.     browser
    
11.     contrib (package)
    
12.     db
    
13.     debugerror
    
14.     form
    
15.     http
    
16.     httpserver
    
17.     net
    
18.     python23
    
19.     session
    
20.     template
    
21.     test
    
22.     utils
    
23.     webapi
    
24.     webopenid
    
25.     wsgi
    
26.     wsgiserver (package)
    
27. 
    
28. SUBMODULES
    
29.     __init__
    
30.     web
    
31. 
    
32. DATA
    
33.     __author__ = ['Aaron Swartz <me@aaronsw.com>', 'Anand Chitipothu <anan...
    
34.     __contributors__ = 'see http://webpy.org/changes'
    
35.     __license__ = 'public domain'
    
36.     __version__ = '0.37'
    
37.     config = <Storage {'debug': True, '__doc__': '\nA configu...A0A0J', 'h...
    
38.     ctx = <ThreadedDict {'__doc__': '\nA `storage` object ...`\n   : A str...
    
39.     generators = _Feature((2, 2, 0, 'alpha', 1), (2, 3, 0, 'final', 0), 0)
    
40.     iters = (<type 'list'>, <type 'tuple'>, <type 'set'>, <type 'set'>)
    
41.     re_compile = <web.utils.Memoize instance>
    
42. 
    
43. VERSION
    
44.     0.37
    
45. 
    
46. AUTHOR
    
47.     ['Aaron Swartz <me@aaronsw.com>', 'Anand Chitipothu <anandology@gmail.com>']
    

復制代碼

isnowran

找到了問題所在, 應(yīng)該是flup多線程不加鎖導致的, 但不知道為啥, 莫非這個參數(shù)會導致flup死鎖?:
哪位大俠能深究一下, 給兄弟長長眼吧
在 /usr/local/lib/python2.7/site-packages/web/wsgi.py:

1. 
   
2. def runfcgi(func, addr=('localhost', 8000)):
   
3.     """Runs a WSGI function as a FastCGI server."""
   
4.     import flup.server.fcgi as flups
   
5.     #return flups.WSGIServer(func, multiplexed=True, bindAddress=addr, debug=False).run()
   
6.     # 改為 multiplexed = False
   
7.     return flups.WSGIServer(func, multiplexed=False, bindAddress=addr, debug=False).run()
   

復制代碼

影響到的flup代碼:
vi /usr/local/lib/python2.7/site-packages/flup/server/fcgi_base.py

1. 
   
2.         if not self.multithreaded:
   
3.             self._appLock.acquire()
   
4.         try:
   
5.             try:
   
6.                 result = self.application(environ, start_response)
   
7.                 try:
   
8.                     for data in result:
   
9.                         if data:
   
10.                             write(data)
    
11.                     if not headers_sent:
    
12.                         write('') # in case body was empty
    
13.                 finally:
    
14.                     if hasattr(result, 'close'):
    
15.                         result.close()
    
16.             except socket.error, e:
    
17.                 if e[0] != errno.EPIPE:
    
18.                     raise # Don't let EPIPE propagate beyond server
    
19.         finally:
    
20.             if not self.multithreaded:
    
21.                 self._appLock.release()
    

復制代碼

freshkkalice

我來學習了！！好帖，支持下！