Forum


Grab RSS feed to Joomla article

Kees van Norde
30%
Posts: 30
TF Import
January 14, 2023

Hi,

Is it possible to grab RSS feeds (with cron job) to Joomla article's?

So articles will be automatic created by this plugin?

Greets Kees.

Tech Fry
100%
Posts: 898
January 15, 2023

Hello

Yes, it is possible to get articles from XML file.

Kees van Norde
30%
Posts: 30
January 15, 2023

Thanks for your response.

I can't do it in the free version yet.
Eventually I want to buy the pro version if I'm sure it works what I want.

I want to import rss items and convert them to joomla articles.
In addition, I would prefer that the accompanying photo of the news item is not imported, but linked. This way you have the advantage that you can see the photo on your own site, but it does not take up space.

I would also like to indicate which category it should be placed in.

Could you give me an example how I can see if it works with the free version?

I know you can't import with the free version but I'd like to buy the pro version as soon as I'm sure it works.
Therefore, I would like to see in the free version whether these elements can be read and displayed.


Greetings, Kees.

Tech Fry
100%
Posts: 898
January 15, 2023

Hello

Can you share RSS feed Url. I will check and make sure it can be imported articles from.

Kees van Norde
30%
Posts: 30
January 15, 2023

https://www.nu.nl/rss/Algemeen

But also other sites :)

I would prefer as optional function that the accompanying photo of the news item is not imported, but linked. This way you have the advantage that you can see the photo on your own site, but it does not take up space.

Greets Kees

Kees van Norde
30%
Posts: 30
January 15, 2023

And does it also check for duplicate items?

Thanks!

Kees van Norde
30%
Posts: 30
January 16, 2023

Hi,

Any update about this? :)

Kees van Norde
30%
Posts: 30
January 17, 2023

Could you let me know if this is possible or not?
Otherwise I'll have to look further.

Tech Fry
100%
Posts: 898
January 17, 2023

Hello

Yes, it is possible to import. There is some small issue while importing from RSS feeds. We are upgrading the component. It will be finished in 4 to 5 days.

After that you can use it to import articles from RSS feeds.

The component can check for duplicate items and for links, you can setup rules to import images or just the Url.

Kees van Norde
30%
Posts: 30
January 17, 2023

Ok thanks for your reply!
I will then wait a while until the problem with RSS is resolved (within 4 to 5 days).

Thank you in advance!

Kees van Norde
30%
Posts: 30
January 17, 2023

I also have another question, can this plugin also import RSS feeds to the kunena forum (as a topic or reply to the forum)?

I think this option is less important, but it would be nice if it could be done in the same plugin :)

Tech Fry
100%
Posts: 898
January 20, 2023

Hello

Now, you can use this extension to import from XML documents. Please update the library and component.

The component cannot be used for Kunena posts or replies.

Kees van Norde
30%
Posts: 30
January 20, 2023

Many thanks!

Is there a manual how i can set it up?
I first want to see that it works before i buy :)

I know that the import function is not in the free version but i understand that the free version can show the funcion?
After i see that i will buy the pro so i can import rss feeds to joomla articles :)

Tech Fry
100%
Posts: 898
January 20, 2023

Import function is there in the free version also. But it is not automatic, manual import is possible.

First, you need to create Grabbers to get or grab the content. For example to get the title, create a new Grabber of type XML value. In the XML tag options, enter title. To check, enter the link of the XML and click Preview. You should see the title. Similarly, you can get description and other values. Complete guide is here.

Next, create a single with content source DOM and destination as Joomla Article. Under the Title tag, select the Grabber you have created in first step. Click Preview to check and Process to import or create the article. Complete guide is here.

Kees van Norde
30%
Posts: 30
January 20, 2023

In the 2nd step i get this error: Resource cannot be empty.

Another question, the title (as test) is not correct.
It is the title from the creator of the XML file.

In the XML file there are 10 news items.
I want the title of the news items (this is how RSS works).

How can i get this titles, description, link to image etc.
Where can i see all the possible values and how can i set the number of items that i will import?

Sorry for the questions, i will buy the pro version if the extension do what i think it has to do.

If there are 5 items in the RSS feed, i will import it to 5 joomla articles.
I hope you understand what i mean :)

Tech Fry
100%
Posts: 898
January 20, 2023

In the second step, enter the RSS url in the Resource field. In the free version, you can import 1 item at a time. In the Pro version, you can import multiple items using Listings.

To get different title, just change the index number (zero means first title) in the options of the Grabber.

Kees van Norde
30%
Posts: 30
January 20, 2023

It is working with the index number, thanks!

But some problems:

In the grabber, how can i get more then 1 value?
When i place "title" in the tag, how can i get the other tags (as example "description" or other things)?
Can i place 1 value or more?

When i place more then 1 i see nothing on the preview, only when i set 1 value.


In the Single the "resource" go always empty after saving. The preview show nothing.
Can you tell me what i doing wrong?

Kees van Norde
30%
Posts: 30
January 21, 2023

Every time when i go to Single and i will process, i get "Resource cannot be empty". I have put this information (the feed) again. When i click on save, the next time i have to put it again. Is this saved in the pro version?

I will buy the pro version, if it is sure that it works.

Another question, is this sure: "you can setup rules to import images or just the Url."?
When i import only the url, the image wil be displayed at the article?

Kees van Norde
30%
Posts: 30
January 22, 2023

And 1 another question, where can i set the author of the article (Joomla article)?

Kees van Norde
30%
Posts: 30
January 22, 2023

And 1 another question, where can i set the author of the article (Joomla article)?

Tech Fry
100%
Posts: 898
January 22, 2023

You can create different Grabbers to get different values for title, description, and so on.

For preview and manual importing, you have to enter the link every time. For automatic importing, the link (or resource) is saved.

You can import the url of image into the custom field and then display the image.

Kees van Norde
30%
Posts: 30
January 22, 2023

I have now purchased the pro version from you.
I just can't figure out how to have the import process done automatically every 5 minutes, for example.

I also have another question, how can I import the image/ image url?

Kees van Norde
30%
Posts: 30
January 24, 2023

Any update about this?

I bought this extension and would like to start using it. I must be doing something wrong but I can't figure out how to get this to work.

So it's about:
1. How do I add an image link to a Joomla article (and how do I place this image link with introtext or fulltext)?

2. How can I have a Single performed, for example, once every 5 minutes?

3. I do see "Auto" at the Single itself. There you can only choose per day or hour (not per minute). But with the autoimport plugin I can set it per minute. How exactly does this work?

Thanks!

Tech Fry
100%
Posts: 898
January 24, 2023

Hello

The Auto Import plugin can process multiple singles or lists automatically. So, you can set it run based on any frequency.

The actual frequency is set in Singles under Auto tab. Currently, you can set to run automatic processing on hourly or daily basis. Why do you want automatic processing to set per 5 minutes? Is your source (XML file) changing that frequently? We can modify the component to include minutes as well.

For directly placing image link in intro text or full text, some improvement is required in the component. We are working on it. It will take 1 to 2 days.

Kees van Norde
30%
Posts: 30
January 24, 2023

Thanks for your response.

1. Yes, the RSS feeds (news items) we use update regularly (several times per hour). For this reason it would be very nice if the option minutes would also be added.

2. It would be great if the option image link in introtext or fulltext is added (I understood it was already there but I think I misunderstood). I mean that this comes at the place where you can specify a picture with a Joomla article. If I now manually put the link of an image there, it works, but I would like to do this automatically during the import.

3. At the moment the Auto function doesn't work yet (it doesn't add articles), if I manually run the same Single the creation works. Do I have to activate something else for this or is the setting at Auto sufficient?

Many thanks!

Kees van Norde
30%
Posts: 30
January 24, 2023

Sorry 1 question more (a lot of questions haha but the extension will be perfect haha).

Is it possible that i can set a option. "Link to original article")?

So i can set a text "click here for original article" under the article and then you will redirect to the original source (open in new window). As example if i import a feed from nu.nl/feed4rgu6 the link will be that. I know in the RSS is this original feed link :)

Tech Fry
100%
Posts: 898
January 25, 2023

Hello

Please update the component and auto import plugin.

1. Now, you can set to update in minutes.

2. Image link can be automatically added in intro text or full text image. In the singles, under the image tab, disable save image.

3. Try clicking Test Run and see if it imports the article. If it imports, you can set up Cron Task to import automatically.

4. For linking to original article, you can create a custom field and in that custom field you can store the link to original article.

Kees van Norde
30%
Posts: 30
January 25, 2023

Thanks for the quick update, my compliments!

I have a few questions because I can't get it to work yet.

1. How do I create a grabber that retrieves the image link (I already have the title and intro text)?

2. I have now set the auto update function to 1x per minute (for the test). But no new items are added. If I do it manually it works fine. You indicate that I need to create a cron. Is just turning on the "auto" function not enough? I don't have to use the autoimport plugin I understood because it's there to import multiple "singles" or "listings"?

What also strikes me is that if I manually execute the import, the "next date" will be on the next day with a completely different time.

Tech Fry
100%
Posts: 898
January 25, 2023

Image link is in enclosure tag with attribute url. So, create a new Grabber of type Xml Attribute.

XML Tag: enclosure

Attribute to Fetch: url

For automatic importing, Auto Import plugin is required even for importing one single. After creating the task, click Test Run to check if it is working.

Kees van Norde
30%
Posts: 30
January 25, 2023

1. The grabber now indeed grabs the link of the image, so that part goes well.

However, in the "single" I can choose an image for introtext and fulltext, only if you want to choose a "grabber" you can't select anything. At "other images" you can select "grabbers".

2. You can both specify a time at "singles (option auto)" and at "auto import (task)". What time does he take then? And should a separate cron also be created in my hosting package or should this be sufficient?

3. I'll take a look at the link to the original article later today :)

Tech Fry
100%
Posts: 898
January 26, 2023

Hello

Please update the extension. The issue of selecting Grabber for intro image and full text image is fixed now.

The frequency for Singles matters if it is more than that of task.

You can use Web Cron (recommended) or Lazy Scheduler as defined in Joomla Scheduled Tasks Configuration.

Kees van Norde
30%
Posts: 30
January 27, 2023

The import images as a link now work perfectly, really great!
It's going to be a really great script like this!

There are still a few small things that are not quite right yet.

1. When I now look at the database, I see that there are still a few things that are different.

Added manually:
{"image_intro":"https:\/\/media.nu.nl\/m\/790xaqiac4x3_sqr256.jpg\/dozens-dead-but-some-survivors-after-plane-crash-in-nepal.jpg", "image_intro_alt":"","float_intro":"","image_intro_caption":"","image_fulltext":"https:\/\/media.nu.nl\/m\/790xaqiac4x3_sqr256.jpg\/dead dozens -but-some-survivors-after-plane-crash-in-nepal.jpg","image_fulltext_alt":"","float_fulltext":"","image_fulltext_caption":""}

Imported via TF Import Pro:
{"image_intro":"https:\/\/media.nu.nl\/m\/8suxirmax1qk_sqr256.jpg\/tweede-kamer-struggles-after-explanation-experts-still-with-new-money-laundering-law.jpg ","image_fulltext":"https:\/\/media.nu.nl\/m\/8suxirmax1qk_sqr256.jpg\/Tweede-kamer-struggles-after-explanation-experts-still-with-new-money-laundering-law. jpg"}

These things are not included: "image_intro_alt":"","float_intro":"
"image_fulltext_alt":"","float_fulltext":"","image_fulltext_caption":""

In addition, a number of things remain empty in the database, these are: urls, attribs, metadata.

As you can see in the photo, this is created with the other articles. See https://kene.nl/database.jpg which info is included with the manual articles and not with the via TF Import Pro.

2. I would like to have a button "Link to original article" at the bottom of the text of full text and then the link to the original article. The readout works, but when I create a custom field for it, I don't see it anywhere. How do I ensure that this becomes a clickable link (opens in a new window) and that it is placed at the bottom of the full text?

3. Sorry I still don't understand you about the CRON. With a Single I can specify a time, with the autoimport I can specify a time and I also understand that I also have to run a CRON separately. What are the times you specify for a Single and for the autoimport plugin?

---

I would like to emphasize that I find the support very good, you always respond very helpfully to my messages and I have the feeling that we are really almost there. It's going to be a really great script!

Tech Fry
100%
Posts: 898
January 30, 2023

Hello

In images, the component doesn't import alt text and caption for images, so these are empty. This will not cause any problems.

For custom field to include link to original article, in the options in Automatic Display, select After Display Content.

For Cron times, lets say you have two singles A and B that you want to run automatically. So, you set up Auto Import plugin and Cron Task to run every 15 minutes. Now, every 15 minutes, the Auto Import plugin will check if there is any Single to be processed based on the frequency set up in Singles. If it finds, the plugin will process the import for the Single, otherwise it will not do anything.

Kees van Norde
30%
Posts: 30
January 30, 2023

Hello,

"For custom field to include link to original article, in the options in Automatic Display, select After Display Content."

Where can I find the "Automatic Display" options?
I looked at Singles and Grabbers.

Kees van Norde
30%
Posts: 30
February 03, 2023

Any idea?

Tech Fry
100%
Posts: 898
February 03, 2023

This is Joomla! option for custom fields. You can find from the left navigation : Content -> Fields. Select the field you have created for the Url. Then under the Options tab.

Kees van Norde
30%
Posts: 30
February 04, 2023

Will it work the way I expect?

Each article that is automatically placed by TF Import has a unique link (link to the original article). It is therefore not a standard link that is the same under every article.

It would be great if this option could still be included in TF Import, this is the last thing I need.

I'm thinking along and maybe an optional option can be added to introtext and fulltext (in my case fulltext would be enough, but I'm thinking along for other users).

Now you can choose 1 grabber for introtext and fulltext.
Would it be an option that you can optionally choose a 2nd grabber (where the link is then retrieved (the link can already be retrieved with a grabber) and that you get what you want as text for the link at an input field.

Then both grabbers (introtext or fulltext together with the 2nd grabber "url" are placed in introtext or fulltext. This would complete the TF Import plugin, I hope you would like to add this option.

Kees van Norde
30%
Posts: 30
February 07, 2023

Is that possible?

Tech Fry
100%
Posts: 898
February 08, 2023

Unfortunately this is not possible. You can use multiple grabbers but you can cannot combine them and insert data into one field.

The second grabber for the Url can be used to store the link in Joomla custom field. The, you can display the field as link or button.

Kees van Norde
30%
Posts: 30
March 25, 2023

Due to private circumstances I unfortunately have not been able to respond for a while, the script actually works perfectly now, but I can't get the cron to work yet. Can you tell me step by step how to do this?

Tech Fry
100%
Posts: 898
March 26, 2023

Hello

You can refer to this guide: https://www.techfry.com/documentation/tf-import-automatic-tasks

Let me know if it works.

Login to Reply