I have a text document that contains a bunch of URLs in this format:
URL = "sitehere.com"
What I'm looking to do is to run curl -K myfile.txt
, and get the output of the response cURL returns, into a file.
How can I do this?
Join Stack Overflow to learn, share knowledge, and build your career.
I have a text document that contains a bunch of URLs in this format:
URL = "sitehere.com"
What I'm looking to do is to run curl -K myfile.txt
, and get the output of the response cURL returns, into a file.
How can I do this?
curl -K myconfig.txt -o output.txt
Writes the first output received in the file you specify (overwrites if an old one exists).
curl -K myconfig.txt >> output.txt
Appends all output you receive to the specified file.
Note: The -K is optional.
For a single file you can use -O
instead of -o filename
to use the last segment of the URL path as the filename. Example:
curl http://example.com/folder/big-file.iso -O
will save the results to a new file named big-file.iso in the current folder. In this way it works similar to wget but allows you to specify other curl options that are not available when using wget.
--remote-name-all
unix.stackexchange.com/a/265819/171025
– qwr
Aug 11 '19 at 18:44
There are several options to make curl output to a file
# saves it to myfile.txt
curl http://www.example.com/data.txt -o myfile.txt
# The #1 will get substituted with the url, so the filename contains the url
curl http://www.example.com/data.txt -o "file_#1.txt"
# saves to data.txt, the filename extracted from the URL
curl http://www.example.com/data.txt -O
# saves to filename determined by the Content-Disposition header sent by the server.
curl http://www.example.com/data.txt -O -J
For those of you want to copy the cURL output in the clipboard instead of outputting to a file, you can use pbcopy
by using the pipe |
after the cURL command.
Example: curl https://www.google.com/robots.txt | pbcopy
. This will copy all the content from the given URL to your clipboard.
xclip
can be used in it's place for Linux see this question. However I would in most cases prefer curl http://example.com -o example_com.html & cat example_com.html | pbcopy
So you wouldn't need to curl again if you accidently clear your clipboard.
– lacostenycoder
Dec 4 '19 at 10:38
curl http://www.textfiles.com/etext/FICTION/fielding-history-243.txt | pbcopy
maybe don't try this!
– lacostenycoder
Dec 4 '19 at 10:51
If you want to store your output into your desktop, follow the below command using post command in git bash.It worked for me.
curl https://localhost:8080 --request POST --header "Content-Type: application/json" -o "C:\Desktop\test.txt"
A tad bit late, but I think the OP was looking for something like:
curl -K myfile.txt --trace-asci output.txt
use --trace-asci output.txt can output the curl details to the output.txt
curl http://{one,two}.example.com -o "file_#1.txt"
curl.haxx.se/docs/manpage.html – onmyway133 May 2 '16 at 20:53