标记一个字符串并在C ++中包含分隔符 [英] Tokenize a string and include delimiters in C++

问题描述

我试图用下面的方法，但不确定如何包括分隔符。

I'm tokening with the following, but unsure how to include the delimiters with it.

void Tokenize(const string str, vector<string>& tokens, const string& delimiters)
{

    int startpos = 0;
    int pos = str.find_first_of(delimiters, startpos);
    string strTemp;


    while (string::npos != pos || string::npos != startpos)
    {

    	strTemp = str.substr(startpos, pos - startpos);
    	tokens.push_back(strTemp.substr(0, strTemp.length()));

        startpos = str.find_first_not_of(delimiters, pos);
        pos = str.find_first_of(delimiters, startpos);

    }
}

推荐答案

C ++字符串工具包库（StrTk）具有以下解决方案：

std::string str = "abc,123 xyz";
std::vector<std::string> token_list;
strtk::split(";., ",
             str,
             strtk::range_to_type_back_inserter(token_list),
             strtk::include_delimiters);

它应该导致token_list有以下元素：

It should result with token_list have the following elements:

Token0 = "abc,"
Token1 = "123 "
Token2 = "xyz"

更多示例可以在这是

这篇关于标记一个字符串并在C ++中包含分隔符的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！