With the collector back in the repo and working with the latest UI, we
can now bump the SQLAlchemy version.
Also update the requirements.txt file that github scans.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
We aren't using the uwsgi python library anywhere so don't pip install
it. We just use the binary which can and should be supplied by the
distro.
uwsgidecoders is a normal python library we rely on, so install it the
same way we install other libraries.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
We need the sites_nginx.conf file that includes collector support for
deploy.sh as well as the one that does not include collector support for
deployui.sh.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Minor changes to the collector code were necessary for it to be
compatible with the latest telemetryui. For example, the database was
renamed to "telemetry" and classifications and build IDs are no longer
in separate tables. These resulted in small changes to the config.py in
the collector directory and the report_handler.py file.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Partially revert commits 6a2b1dd1 'Redesigned the telemetry backend app'
and fa4b233f 'Removed the "shared" folder'.
These commits removed the collector app from the telemetrics-backend
project, but we still supported deploying the collector from old
versions of the project. This resulted in a situation where we could not
update collector code.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Ubuntu 16.04 does not have a 'redis' package, it has 'redis-server'.
Ubuntu 18.04 has both and they're essentially aliases of eachother.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
When we deploy new code we should also be sure to upgrade the python
packages in the virtualenv to match the code.
Also fix the deployui.sh script's do_deploy. There was no conf variable
set in _get_db_pass, causing the script to hang.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
This will install current requirements into the virtualenv. Previously
we had no easy way to do so.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Fixes CVE-2019-7548 in the latest UI.
deploy.sh also needs to be updated, but it requires code changes and
some housekeeping.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
With the upgraded psycopg2 version this no longer works and in fact
causes the following error:
Command "/var/www/telemetry/venv/bin/python3 -u -c "import setuptools, tokenize;__file__='/tmp/pip-install-froo6p21/psycopg2/setup.py';f=getattr(tokenize, 'open', open)(__file__);code=f.read().replace('\r\n', '\n');f.close();exec(compile(code, __file__, 'exec'))" install --record /tmp/pip-record-bv0up7o3/install-record.txt --single-version-externally-managed --compile --install-headers /var/www/telemetry/venv/include/site/python3.7/psycopg2" failed with error code 1 in /tmp/pip-install-froo6p21/psycopg2/
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
The caching additions require redis and the redis python module. Add
them to the requirements, and also enable/start redis where appropriate.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
v2.7.3 does not work on Ubuntu 18 or recent versions of Clear. Use
v2.7.6 instead.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
These could be required for other software on the system, not just the
telemetryui, and should not be unconditionally removed. Instead just
tell the user that they can remove them if they wish.
Signed-off-by: California Sullivan <california.l.sullivan@intel.com>
Spool processing of crashes requires uwsgidecorators module, in clear
linux the module uwsgi is provided by a bundle but not the decorator.
This change adds installation of uwsgidecorators module to section where
requirements are installed based on the distro.
Signed-off-by: Alex Jaramillo <alex.v.jaramillo@intel.com>
Forking deploy script to support deployment of releases (tagged) and to
have a script to deploy ui only.
Signed-off-by: Alex Jaramillo <alex.v.jaramillo@intel.com>
Updating required flask version to 0.12.3 that has a patch that fixes
CVE-2018-1000656. App is know to work with Flask 0.12.3
Signed-off-by: Alex Jaramillo <alex.v.jaramillo@intel.com>
- Added migration code to modify 'records' table as follows:
- Rename 'os_name' ==> 'system_name'
- Rename 'machine' ==> 'host_type'
- Rename 'payload_format_version' ==> 'payload_version'
- Rename 'record_format_version' ==> 'record_version'
- Rename 'tsp' ==> 'timestamp_client'
- Rename 'tsp_server' ==> 'timestamp_server'
- Modify 'payload' type from binary to text
- Remove 'buildstamp'
- Remove 'dupe_of'
- Remove 'dupecount'
- Remove 'dupemaster'
- Remove 'security'
- Remove 'hide'
- Remove 'icon'
- Add 'build'
- Add 'classification'
- Updated code to reflect the above design changes.
- Updated code to remove references to 'backtrace' column.
But not from the table because data migration from
'backtrace' to 'payload' should be done first.
- Added migration code to update the table data based on the above
design changes.
- Added migration code to update the Views based on the above design
changes.
- Removed the 'collector' app.
- Modified database name to 'telemetry'.
- Added code to filter out build id >= 100000.
Using system provided uwsgi and reworking application definition
section for telemetry and collector vassals.
clr-on-clr bundle no longer needed for Clear Linux.
Running 'apt-get update' and 'yum check-update' before installing
packages.
Signed-off-by: avjarami <alex.v.jaramillo@intel.com>
Requirements file will not be present when deploy.sh
script is executed, this means it should be created
during the deploy script execution, requirements.txt
will be created under /tmp folder.
California Sullivan