mirror of
https://gitlab.ub.uni-bielefeld.de/sfb1288inf/nopaque.git
synced 2024-11-15 01:05:42 +00:00
Delete docs, it got replaced by wiki pages.
This commit is contained in:
parent
da6502d665
commit
724d2a47cd
@ -1,95 +0,0 @@
|
|||||||
## Web Server
|
|
||||||
- **Solutions**:
|
|
||||||
- Apache (with mod WSGI)
|
|
||||||
- or nginx (with gunicorn I guess)
|
|
||||||
- **Goal/Function**:
|
|
||||||
- Serves content
|
|
||||||
- handels HTTP requests etc.
|
|
||||||
- handels encryption
|
|
||||||
- with SSL/TLS and Let's encrypt
|
|
||||||
- serves forms for user request and inputs
|
|
||||||
- has copy of Joblist to display those for the user according to requests etc.
|
|
||||||
- talks to the Manager service
|
|
||||||
- Users CANNOT talk directly with the manager
|
|
||||||
- has list of all currently running user sessions (maybe used for authentication)
|
|
||||||
|
|
||||||
## Application Server
|
|
||||||
- **Solution**: Flask
|
|
||||||
|
|
||||||
### Authentication and session management
|
|
||||||
- **Solutions**:
|
|
||||||
- Flask-Login (minimal)
|
|
||||||
- Flask-Session (maybe a bit more functions)
|
|
||||||
- **Goal/Function**
|
|
||||||
- handels both internal and external users
|
|
||||||
- Relational Database
|
|
||||||
- **Solutions**_
|
|
||||||
- PostgreSQL
|
|
||||||
- MariaDB
|
|
||||||
- Object Relational Mapper
|
|
||||||
- **Solutions**:
|
|
||||||
- Flask-SQLAlchemy
|
|
||||||
|
|
||||||
### Manager Service:
|
|
||||||
- Part of the Application Server
|
|
||||||
- manages also files on file server
|
|
||||||
- Joblist
|
|
||||||
- **Solution**:
|
|
||||||
- http://www.celeryproject.org/
|
|
||||||
- Thread safe
|
|
||||||
- Scheduling
|
|
||||||
- Ressource management
|
|
||||||
- REST API
|
|
||||||
- **Solution**
|
|
||||||
- Flask internal
|
|
||||||
- and also part of celery
|
|
||||||
- **Goal/Function**
|
|
||||||
- Passes requests to the joblist/celery
|
|
||||||
- Functions:
|
|
||||||
- create_job
|
|
||||||
- delete_job
|
|
||||||
- get_job (JSON Object or metadata or both?)
|
|
||||||
- alter_job
|
|
||||||
- Mail notifications
|
|
||||||
- **Solution**:
|
|
||||||
- Flask-Mail
|
|
||||||
- **Goal/Function**
|
|
||||||
- Sends Mails to users if a OCR job has finished
|
|
||||||
|
|
||||||
## OCR containers with tesseract
|
|
||||||
- **Goal/Function**
|
|
||||||
- celery checks joblists continiously
|
|
||||||
- job start commands will be passed to the containers
|
|
||||||
- jobs will be started accordingly
|
|
||||||
|
|
||||||
## Compute pool: Docker Cluster
|
|
||||||
- **Solutions**:
|
|
||||||
- Kubernetes
|
|
||||||
- swarm
|
|
||||||
- **Goal/Function**
|
|
||||||
- How to handle job and resource management for user Jobs and processes.
|
|
||||||
- gets requests and tasks from the manager
|
|
||||||
|
|
||||||
## File Server (Scans, pdfs etc.)
|
|
||||||
- **Goal/Function**
|
|
||||||
- stores user input and
|
|
||||||
- output files
|
|
||||||
- Upload
|
|
||||||
- Download
|
|
||||||
- **Solutions**:
|
|
||||||
- WebDAV/Samba/Docker Volume
|
|
||||||
|
|
||||||
# Additional Functions
|
|
||||||
|
|
||||||
## Information retrival system
|
|
||||||
- **Solutions**:
|
|
||||||
- CEQUL with CWB Server
|
|
||||||
- Lucene
|
|
||||||
- **Functions/Goals**
|
|
||||||
- KWIC
|
|
||||||
- KWIC with complex querys (POS, NER, Lemma querys)
|
|
||||||
- Frequency lists
|
|
||||||
- n-grams
|
|
||||||
- complex n-grams
|
|
||||||
- etc.
|
|
||||||
|
|
@ -1 +0,0 @@
|
|||||||
<mxfile modified="2019-04-17T12:49:28.623Z" host="www.draw.io" agent="Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:66.0) Gecko/20100101 Firefox/66.0" etag="JmPgRII5KerP40fNuYKp" version="10.6.3" type="device"><diagram id="u0ifZDnm1cNV0CSORuqK" name="Page-1">3VpZc9o6FP41zKQPyXhhCY+U5ba905lOaSfNU0fYAruRJSrJYPLr75Et45XgsIUbXpCOtZzlO8efBC17GET/cLT0vjIXk5ZluFHLHrUsyzLsNnwpySaRmKbdSSQL7rtalgmm/jPWQkNLQ9/FojBQMkakvywKHUYpdmRBhjhn6+KwOSPFXZdogSuCqYNIVfrgu9JLpPdWL5N/wv7CS3c2u/3kSYDSwdoS4SGXrXMie9yyh5wxmbSCaIiJ8l7ql2TeZMfTrWIcU9lkwvSPYfwcPM+eJ/aPaCxR/9Ye3+pVVoiE2uCHhwetr9ykThBrPyCIQu+jHo+5xNFORcyteQAMzAIs+QaG6Alt7ZBNsbvO3LuVeTnX2qkjkQ7pYrtyZjU0tOGvcIJVcULL6hLY9qPrr6C5kLHhiWiWCiYEiadUCvvOKiN5WQKjalasEc0ZuDIfgu7fkKUPbkWcJQMYYFrLKHsYpwFhvDCjZdn9+JMXpbvZMOUPA80N4gsZz1+qSN1wjFz4ZpRsPuS0T/T6Hxi1wFLAF8dzjoWHlS0YQKtsExhqhbvHqANit0I88ebvxJdHg+B4/BzgOI7/hjiBAnI8/KIup0DD4bGdk/CQyDaMo/bD74IXrjt0AgvhMypO44Ca1a7Y9lBgpbRPJebIkaC4QkhI4+Y+jxygsVpaVU228OlNSFEAGBkqPZZIiDXj7ofXLgWo/sJm4mbuE7BBNJ9/d3f3tsVm++IbLJNkmVDwSpRbp/JqvIhae6eWWA4wGiX3ZADsYWRCU0jOnvBQw5GymAFBgEhJhIi/oNAleB4nELAjHyjkQIslW4J07fkST8FFars10GWQcRZSFytuYmw12sOtdtO4KuHSDMtuyLCs/rkYVqfCsL4iCtSZn5lqdqxr45rdJlwTOItgIQekFOnZ+ZMnv7OqqeIiibi/tAzV8S6Ky/oRVeX7ePoDDBt8+xwfBfnF3Vux699whjnFEovjDMuFLYgzK8D0FRz0/VTCzpVXwl4l/yc+UdG/aB3c9t+uEN43KYSxbzBfqRdFw1SYTj+pg6vK7TWeuWj1/jHfu3LM96uXTIw/vfzyFxJxqa8DgeGfJAtMw7g2OpBec9akwfYtMGLOUyEBZu8RxP0rB7FZrdyaTjgsCEIK3kqOnWVMe2ipmnOCo4G6kAYvYerq5sghcGD0nRTxVXEuluBAvvmlPR13HlXnrpN2R1H+4WiT9iJf/krXgHZuFvSySaqzKQQSu5Xb8VKyga0J8dh7vQrmwRl3HzWuIiAX8k5NxFMZxwQCsCqqW4cCvcM35seXDfWX0n2zhKPESj0pf8teWqdfXOe+W1on8UJlnRiSW6OPuMqu1pPkpBVfjgDEqFNHNk6I0QOwdiiuT4jRbkOMmkbrDUF6bxbRZZntA1Ha3bPQuWFa/cnle/KLA1IXuMaaw4tGndHqufE5SmqGtscC2F4uqRm0H3OgP3tJ7TSE6w5meBm0dkoga5drYVO03pdp26WLavX6qvYMvhvAjU4gZ6jCRqEK95qWYT2yaTKcENhpgbtuZHc7RUDavQOR3SsV9HaZvp4b2TWkNoHxkZW3rsSaBUzlMLa3xlr5Imtcqsj2GkLReksoXj1vhW72H5dkePZXIXv8Hw==</diagram></mxfile>
|
|
Binary file not shown.
Before Width: | Height: | Size: 53 KiB |
@ -1,13 +0,0 @@
|
|||||||
##### books:
|
|
||||||
- Flask By Example
|
|
||||||
http://web.b.ebscohost.com/ehost/detail/detail?vid=3&sid=88df57d6-b0af-42aa-aeda-3f96f2d80c8e%40sessionmgr120&bdata=JnNpdGU9ZWhvc3QtbGl2ZQ%3d%3d#AN=1215157&db=nlebk
|
|
||||||
|
|
||||||
#### videos:
|
|
||||||
- Learning Flask
|
|
||||||
- https://www.lynda.com/Flask-tutorials/Learning-Flask/704154-2.html
|
|
||||||
- Building Web APIs with Flask
|
|
||||||
- https://www.lynda.com/Flask-tutorials/Web-API-Development-Flask/521200-2.html?
|
|
||||||
|
|
||||||
#### online:
|
|
||||||
- The Flask Mega-Tutorial
|
|
||||||
- https://blog.miguelgrinberg.com/post/the-flask-mega-tutorial-part-i-hello-world
|
|
Loading…
Reference in New Issue
Block a user