1
0
mirror of https://github.com/chylex/Nextcloud-News.git synced 2024-10-17 08:42:48 +02:00
Commit Graph

38 Commits

Author SHA1 Message Date
Benjamin Brahmer
b1476e958a If timestamp is null use timestamp "one year ago"
if timestamp is not set during creation of a feed use date one year ago
code fixes and linting fixes.

Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2023-03-23 12:12:06 +01:00
Accalia Elementia
fdf037e728
Use Feed Link as GUID when Feed omits Guid. (#1785)
* Use Feed Link as GUID when Feed omits Guid.

As noted in nextcloud/news#1702 some feeds omit the GUID and are
therefore not a valid RSS feed.

nextcloud/news#1738 resolved the issue to allow valid feeds to
update correctly when an invalid feed is present.

This commit allows parsing of the invalid feed as well by assuming
that the item link of the feed is unique to the feed and using
it in place of the GUID when the feed omits the GUID.

This will allow NextCloud News to accept and behave like many other
popular feed aggregators when presented with such an invalid feed.

Signed-off-by: Accalia <Accalia@Elementia.me>

* Add basic Logging when using fallback guid

Signed-off-by: Accalia <Accalia@Elementia.me>

* Add basic Logging when using fallback guid - Fix Fatfinger Typo

Signed-off-by: Accalia <Accalia@Elementia.me>

* Add basic Logging when using fallback guid - Update tests to account for additional logging

Signed-off-by: Accalia <Accalia@Elementia.me>
2022-05-24 17:07:50 +02:00
nextcloud486153
032d48ad7b Fix malformed feeds (without GUIDs) stopping the update process (fixes #1738)
Signed-off-by: nextcloud486153 <78801830+nextcloud486153@users.noreply.github.com>
2022-04-18 13:16:01 +02:00
Benjamin Brahmer
7d61a1cb09 Download feed logos via guzzle to have better error handling
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-10-18 17:57:18 +02:00
anoy
91db7113a8 replace deprecated getDescription call
Signed-off-by: anoy <anoymouserver+github@mailbox.org>
2021-04-24 14:21:57 +02:00
Marco Nassabain
b4aab69304 FeedFetcher: update tests to include categories
Signed-off-by: Marco Nassabain <marco.nassabain@hotmail.com>
2021-03-17 08:58:42 +01:00
Benjamin Brahmer
6cd83ea1da remove unused lastModified from feed fetcher
Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
2021-02-16 11:01:10 +01:00
Benjamin Brahmer
c09b4d8d33 prefer the feeds logo over the favicon
The logo of the feed is prefered if it is a square picture,
else the favicon is returned.

Signed-off-by: Benjamin Brahmer <info@b-brahmer.de>
Co-authored-by: Sean Molenaar <SMillerDev@users.noreply.github.com>
2021-02-16 10:16:15 +01:00
Sean Molenaar
6e9e2512ea DB: Remove unused fields
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-02-05 09:37:17 +01:00
Sean Molenaar
8fa1537cbf Fetcher: Update client and add test
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2021-01-20 22:52:09 +01:00
Kevin Decherf
42ea24f2f4 Remove LastModified-based cursor when updating feeds
We remove the call to readSince() as some feeds push new articles with
pubDate prior to the lastModified time stored for these feeds (e.g.
lemonde.fr). As we go through all items of a feed again and again, we
prevent the constant update of an item's lastModified timestamp by
keeping the previous one if its fingerprint does not change.

Fixes #921

Signed-off-by: Kevin Decherf <kevin@kdecherf.com>
2020-12-15 20:02:21 +01:00
anoy
cb32a2c4ed remove deprecated YouTube playlist API
Signed-off-by: anoy <anoymouserver+github@mailbox.org>
2020-11-07 09:57:20 +01:00
Sean Molenaar
48a130d3c0 Allow titles to be null
Issue GH-867

Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-10-12 21:40:23 +02:00
Sean Molenaar
e528361141 Add feed autodiscovery
Issue GH-415

Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-29 21:15:53 +02:00
Sean Molenaar
d00d1ab2a2 Create V2 mapper, Service and management commands
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-27 15:35:31 +02:00
Sean Molenaar
60ab4941cc Move to nextcloud config and update phpunit
Signed-off-by: Sean Molenaar <sean@seanmolenaar.eu>
2020-09-25 19:18:04 +02:00
kesselb
f045bd0ba3 Update httpLastModified from the feed response (#594)
LastModified is used (in a feed context to see if a user edited a feed). httpLastModified to store the last-modified response from the source.

Signed-off-by: Daniel Kesselberg <mail@danielkesselberg.de>
2019-12-27 03:51:06 +01:00
DriverXX
6673cbc3d9 Reimplement full-text scraping (#563)
Add readability.php scraper
Fixes #482
Signed-off-by: Gioele Falcetti <thegio.f@gmail.com>
2019-12-24 09:33:19 +01:00
b_b
35c6c91e26 Get content:encoded of item if available (#565)
Get content:encoded of item if available fixes #564

Signed-off-by: brunob <bruno@eliaz.fr>
2019-11-16 14:21:40 +01:00
Sean Molenaar
b37e237c7a Fix xkcd commics 2019-03-26 09:31:03 +01:00
Sean Molenaar
c69bcb8e68 Allow empty-ish lastmodified and clean up FeedFetcher Test (#458) 2019-03-21 05:16:35 +01:00
Sean Molenaar
2698214c41 fix/allow CDATA encoding (#428) 2019-03-17 08:23:37 +01:00
Sean Molenaar
f416213993 Fix email and password not being encoded 2019-03-12 19:58:06 +01:00
Sean Molenaar
da0872c5ca Fix references to old manual versions and general cleanup (#404) 2019-03-06 17:04:52 +01:00
Sean Molenaar
7c17b2c24b
Allow empty update time 2019-02-23 16:11:28 +01:00
Sean Molenaar
ee6bb6ce70
Fix mismatched interface 2019-01-31 13:40:52 +01:00
Sean Molenaar
a3246a927d
Parser: Switch to feedIO for parsing instead of picoFeed 2019-01-30 20:36:40 +01:00
Daniel Opitz
e158cc1d3b use magic class constant instead of classname strings 2018-12-04 17:10:46 +01:00
Sean Molenaar
fa5f07ba9a Put back old tests for stable nextcloud version 2018-10-02 14:33:09 +02:00
Sean Molenaar
5b94705cf3 Core: Fix compatibility with nextcloud codestyle (#280) 2018-03-27 15:35:06 +02:00
Sean Molenaar
17e85dd507 Unit: Fix unittests (#278)
* Unit: Fix unittests

Issue #171

* Tests: Move test namespace to the expected nextcloud namespace
2018-03-18 15:01:08 +01:00
Daniel Opitz
a97dd58e3b Split binary to booleans (#203)
* replaced old status with 2 flags for unread and starred

* add fields to db, replace int(1,0) with booleans in sql queries, removed StatusFlags class + refactor code relying to it

* add repair step for migration

* again use integer(1,0) instead of bool in sql queries, because of sqlite doesn't support true/false

* add/fix unit tests for new boolean status

* set unread/starred flags as statements in sql

* fixed mysql unknown column items.unread, fixed marking of read items on repair step

* remove unnecessary bool casts

* add empty checks to Items::is* methods

* update migration to use native sql instead of the querybuilder

* don't cast the flags manually, let the api do the work
2017-08-14 10:34:53 +02:00
Robin Appelman
bc27596f70 Add postprocessor for getting lwn subscriber articles (#72) 2017-01-04 11:10:19 +01:00
Daniel Schaal
04f66c9710 Add updatedDate to item model (#81)
* Update picoFeed to v0.1.28

* Add updated_date to database and bump version to 10.1.1

* Add updatedDate to item model

* Check for updatedDate when updating a feed

* Fix unit test to check for newer updatedDate
2017-01-04 11:09:46 +01:00
Bernhard Posselt
8d63975360 revert 2016-10-02 18:05:49 +02:00
Daniel Schaal
e45511f6ba Add updatedDate to item model (#43)
* Update picoFeed to 0.1.25

* Add updated_date to database

* Add updatedDate to item model

* Bump version to 9.0.5

* Check for updatedDate when updating a feed

* Fix unit test to check for newer updatedDate
2016-10-01 08:34:40 +02:00
Bernhard Posselt
7a3a22bd27 Adjust copyright header 2016-07-23 21:32:42 +02:00
Bernhard Posselt
004fcbbcc7 Move to new directory structure 2016-07-23 21:24:54 +02:00