I've looked at the regex functions in the POSIX regex library and the PCRE library, but both of them don't seem to have a string replacement function. I don't want to use C++, and it would be best if I don't need to link another library (but I can if I have to). Do I need to manually do the string replacing? If so, how can I use capture groups?
-
What capture groups are you referring to? There is no builtin C library for regex, you will have to use pcre or somithing like that.– lvellaNov 7, 2011 at 23:23
-
In general you can't do string replacements inside a C string - you might not have the available memory. Can you clarify what exactly you're trying to do?– Carl NorumNov 7, 2011 at 23:24
-
So you want me to be specific? I have an HTTP request header that I want to use regex to change and forward to the server.– YifanNov 7, 2011 at 23:28
-
2This may help: linuxquestions.org/questions/programming-9/… -– Alvin K.Nov 7, 2011 at 23:30
-
Thanks for the link Alvin. Is there no way to do a search-and-replace with regex though?– YifanNov 7, 2011 at 23:32
4 Answers
regex.h does not provide native support for string replacement, however it does provide subexpressions/capture groups which make it much easier. I'll assume that you're familiar with regex compilations and skip to regex execution and subexpressions.
regexec() is defined as follows in regex.h (/usr/include/):
extern int regexec (const regex_t *__restrict __preg,
const char *__restrict __string, size_t __nmatch,
regmatch_t __pmatch[__restrict_arr],
int __eflags);
The first, second, and final arguments are the regex, string to be executed on and execution flags, respectively. The third and fourth arguments are used to specify an array of regmatch_t's. A regmatch_t consists of two fields: rm_so and rm_eo, which are the indices, or offsets, of the beginning and end of the matched area, respectively. Theses indices can then be used along with memcpy(), memset() and memmove()from string.h to perform string replacement.
I'll make a little example and post it later.
Good luck, and I hope that this helped.
-
12I'll make a little example and post it later. When? You made this promise 5 years ago. ;( Here are few examples I've found so far. Jan 2, 2016 at 12:52
The PCRE library itself does not provide a replace function, but there is a wrapper function available at the PCRE downloads page that accepts perl style =~ s/pattern/replace/
syntax and then uses the PCRE native functions to do a substitute/replace for you. Go to http://www.pcre.org/ then click on the Download link: ftp://ftp.csx.cam.ac.uk/pub/software/programming/pcre/, then the Contrib directory. The package/project you want is: pcrs-0.0.3-src.tar.gz
.
Note that I have not used this myself so I cannot testify as to how well it works. It is a fairly small and simple piece of code however, so it may well serve your purpose nicely.
-
Hi, thanks for the link. But how do I use pcrs in my programme? I currently use pcre_compile and pcre_exec functions as here stackoverflow.com/a/1421923/1729501 Jul 31, 2013 at 8:13
I've taken the post by @marnout and fixed it up addressing a number of bugs and typos. Fixes:memory leaks, infinite replacement if replacement contains pattern, printing in function replaced with return values, back reference values actually up to 31, documentation, more test examples.
/* regex_replace.c
:w | !gcc % -o .%<
:w | !gcc % -o .%< && ./.%<
:w | !gcc % -o .%< && valgrind -v ./.%<
*/
#include <stdlib.h>
#include <stdio.h>
#include <string.h>
#include <regex.h>
int regex_replace(char **str, const char *pattern, const char *replace) {
// replaces regex in pattern with replacement observing capture groups
// *str MUST be free-able, i.e. obtained by strdup, malloc, ...
// back references are indicated by char codes 1-31 and none of those chars can be used in the replacement string such as a tab.
// will not search for matches within replaced text, this will begin searching for the next match after the end of prev match
// returns:
// -1 if pattern cannot be compiled
// -2 if count of back references and capture groups don't match
// otherwise returns number of matches that were found and replaced
//
regex_t reg;
unsigned int replacements = 0;
// if regex can't commpile pattern, do nothing
if(!regcomp(®, pattern, REG_EXTENDED)) {
size_t nmatch = reg.re_nsub;
regmatch_t m[nmatch + 1];
const char *rpl, *p;
// count back references in replace
int br = 0;
p = replace;
while(1) {
while(*++p > 31);
if(*p) br++;
else break;
} // if br is not equal to nmatch, leave
if(br != nmatch) {
regfree(®);
return -2;
}
// look for matches and replace
char *new;
char *search_start = *str;
while(!regexec(®, search_start, nmatch + 1, m, REG_NOTBOL)) {
// make enough room
new = (char *)malloc(strlen(*str) + strlen(replace));
if(!new) exit(EXIT_FAILURE);
*new = '\0';
strncat(new, *str, search_start - *str);
p = rpl = replace;
int c;
strncat(new, search_start, m[0].rm_so); // test before pattern
for(int k=0; k<nmatch; k++) {
while(*++p > 31); // skip printable char
c = *p; // back reference (e.g. \1, \2, ...)
strncat(new, rpl, p - rpl); // add head of rpl
// concat match
strncat(new, search_start + m[c].rm_so, m[c].rm_eo - m[c].rm_so);
rpl = p++; // skip back reference, next match
}
strcat(new, p ); // trailing of rpl
unsigned int new_start_offset = strlen(new);
strcat(new, search_start + m[0].rm_eo); // trailing text in *str
free(*str);
*str = (char *)malloc(strlen(new)+1);
strcpy(*str,new);
search_start = *str + new_start_offset;
free(new);
replacements++;
}
regfree(®);
// ajust size
*str = (char *)realloc(*str, strlen(*str) + 1);
return replacements;
} else {
return -1;
}
}
const char test1[] = "before [link->address] some text [link2->addr2] trail[a->[b->c]]";
const char *pattern1 = "\\[([^-]+)->([^]]+)\\]";
const char replace1[] = "<a href=\"\2\">\1</a>";
const char test2[] = "abcabcdefghijklmnopqurstuvwxyzabc";
const char *pattern2 = "abc";
const char replace2[] = "!abc";
const char test3[] = "a1a1a1a2ba1";
const char *pattern3 = "a";
const char replace3[] = "aa";
int main(int argc, char *argv[])
{
char *str1 = (char *)malloc(strlen(test1)+1);
strcpy(str1,test1);
puts(str1);
printf("test 1 Before: [%s], ",str1);
unsigned int repl_count1 = regex_replace(&str1, pattern1, replace1);
printf("After replacing %d matches: [%s]\n",repl_count1,str1);
free(str1);
char *str2 = (char *)malloc(strlen(test2)+1);
strcpy(str2,test2);
puts(str2);
printf("test 2 Before: [%s], ",str2);
unsigned int repl_count2 = regex_replace(&str2, pattern2, replace2);
printf("After replacing %d matches: [%s]\n",repl_count2,str2);
free(str2);
char *str3 = (char *)malloc(strlen(test3)+1);
strcpy(str3,test3);
puts(str3);
printf("test 3 Before: [%s], ",str3);
unsigned int repl_count3 = regex_replace(&str3, pattern3, replace3);
printf("After replacing %d matches: [%s]\n",repl_count3,str3);
free(str3);
}
-
new = (char *)malloc(strlen(*str) + strlen(replace))
does not look correct. say,pattern = "(hello)(world)"
andreplace = "\1\2\1\2"
– pynexjJul 27, 2022 at 11:57
/* regex_replace.c
:w | !gcc % -o .%<
:w | !gcc % -o .%< && ./.%<
*/
#include <stdlib.h>
#include <stdio.h>
#include <string.h>
#include <regex.h>
void // *str MUST can be freed, i.e. obtainde by strdup, malloc, ...
regex_replace(char **str, const char *pattern, const char *replace) {
regex_t reg;
// if regex can't commpile pattern, do nothing
if(!regcomp(®, pattern, REG_EXTENDED)) {
size_t nmatch = reg.re_nsub;
regmatch_t m[nmatch + 1];
const char *rpl, *p;
// count back references in replace
int br = 0;
p = replace;
while(1) {
while(*++p > 31);
if(*p) br++;
else break;
} // if br is not equal to nmatch, leave
if(br != nmatch) return;
// look for matches and replace
char *new;
while(!regexec(®, *str, nmatch + 1, m, REG_NOTBOL)) {
// make enough room
new = (char *)malloc(strlen(*str) + strlen(rpl));
if(!new) exit(EXIT_FAILURE);
*new = 0;
p = rpl = replace;
int c;
strncat(new, *str, m[0].rm_so); // test before pattern
for(int k=0; k<nmatch; k++) {
while(*++p > 16); // skip printable char
c = *p; // back referenc (e.g. \1, \2, ...)
strncat(new, rpl, p - rpl); // add head of rpl
// concat match
strncat(new, *str + m[c].rm_so, m[c].rm_eo - m[c].rm_so);
rpl = p++; // skip back reference, next match
}
strcat(new, p ); // trailing of rpl
strcat(new, *str + m[0].rm_eo); // trainling text in *str
free(*str);
*str = strdup(new);
free(new);
}
// ajust size
*str = (char *)realloc(*str, strlen(*str) + 1);
} else
printf("Could not compile regex: %s\n", replace);
}
int main(int argc, char *argv[])
{
char *pattern = "\\[([^-]+)->([^]]+)\\]";
char *str = strdup("before [link->address] some text [link2->addr2] trail");
char rpl[] = "<a href=\"\2\">\1</a>";
puts(str);
regex_replace(&str, pattern, rpl);
puts(str);
free(str);
}