org.apache.hadoop.mapred.lib.KeyFieldBasedComparator Java Examples

The following examples show how to use org.apache.hadoop.mapred.lib.KeyFieldBasedComparator. You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example #1
Source File: JobConf.java    From hadoop with Apache License 2.0 4 votes vote down vote up
/**
 * Get the {@link KeyFieldBasedComparator} options
 */
public String getKeyFieldComparatorOption() {
  return get(KeyFieldBasedComparator.COMPARATOR_OPTIONS);
}
 
Example #2
Source File: JobConf.java    From big-c with Apache License 2.0 4 votes vote down vote up
/**
 * Get the {@link KeyFieldBasedComparator} options
 */
public String getKeyFieldComparatorOption() {
  return get(KeyFieldBasedComparator.COMPARATOR_OPTIONS);
}
 
Example #3
Source File: JobConf.java    From hadoop with Apache License 2.0 2 votes vote down vote up
/**
 * Set the {@link KeyFieldBasedComparator} options used to compare keys.
 * 
 * @param keySpec the key specification of the form -k pos1[,pos2], where,
 *  pos is of the form f[.c][opts], where f is the number
 *  of the key field to use, and c is the number of the first character from
 *  the beginning of the field. Fields and character posns are numbered 
 *  starting with 1; a character position of zero in pos2 indicates the
 *  field's last character. If '.c' is omitted from pos1, it defaults to 1
 *  (the beginning of the field); if omitted from pos2, it defaults to 0 
 *  (the end of the field). opts are ordering options. The supported options
 *  are:
 *    -n, (Sort numerically)
 *    -r, (Reverse the result of comparison)                 
 */
public void setKeyFieldComparatorOptions(String keySpec) {
  setOutputKeyComparatorClass(KeyFieldBasedComparator.class);
  set(KeyFieldBasedComparator.COMPARATOR_OPTIONS, keySpec);
}
 
Example #4
Source File: JobConf.java    From big-c with Apache License 2.0 2 votes vote down vote up
/**
 * Set the {@link KeyFieldBasedComparator} options used to compare keys.
 * 
 * @param keySpec the key specification of the form -k pos1[,pos2], where,
 *  pos is of the form f[.c][opts], where f is the number
 *  of the key field to use, and c is the number of the first character from
 *  the beginning of the field. Fields and character posns are numbered 
 *  starting with 1; a character position of zero in pos2 indicates the
 *  field's last character. If '.c' is omitted from pos1, it defaults to 1
 *  (the beginning of the field); if omitted from pos2, it defaults to 0 
 *  (the end of the field). opts are ordering options. The supported options
 *  are:
 *    -n, (Sort numerically)
 *    -r, (Reverse the result of comparison)                 
 */
public void setKeyFieldComparatorOptions(String keySpec) {
  setOutputKeyComparatorClass(KeyFieldBasedComparator.class);
  set(KeyFieldBasedComparator.COMPARATOR_OPTIONS, keySpec);
}
 
Example #5
Source File: JobConf.java    From RDFS with Apache License 2.0 2 votes vote down vote up
/**
 * Set the {@link KeyFieldBasedComparator} options used to compare keys.
 *
 * @param keySpec the key specification of the form -k pos1[,pos2], where,
 *  pos is of the form f[.c][opts], where f is the number
 *  of the key field to use, and c is the number of the first character from
 *  the beginning of the field. Fields and character posns are numbered
 *  starting with 1; a character position of zero in pos2 indicates the
 *  field's last character. If '.c' is omitted from pos1, it defaults to 1
 *  (the beginning of the field); if omitted from pos2, it defaults to 0
 *  (the end of the field). opts are ordering options. The supported options
 *  are:
 *    -n, (Sort numerically)
 *    -r, (Reverse the result of comparison)
 */
public void setKeyFieldComparatorOptions(String keySpec) {
  setOutputKeyComparatorClass(KeyFieldBasedComparator.class);
  set("mapred.text.key.comparator.options", keySpec);
}
 
Example #6
Source File: JobConf.java    From hadoop-gpu with Apache License 2.0 2 votes vote down vote up
/**
 * Set the {@link KeyFieldBasedComparator} options used to compare keys.
 * 
 * @param keySpec the key specification of the form -k pos1[,pos2], where,
 *  pos is of the form f[.c][opts], where f is the number
 *  of the key field to use, and c is the number of the first character from
 *  the beginning of the field. Fields and character posns are numbered 
 *  starting with 1; a character position of zero in pos2 indicates the
 *  field's last character. If '.c' is omitted from pos1, it defaults to 1
 *  (the beginning of the field); if omitted from pos2, it defaults to 0 
 *  (the end of the field). opts are ordering options. The supported options
 *  are:
 *    -n, (Sort numerically)
 *    -r, (Reverse the result of comparison)                 
 */
public void setKeyFieldComparatorOptions(String keySpec) {
  setOutputKeyComparatorClass(KeyFieldBasedComparator.class);
  set("mapred.text.key.comparator.options", keySpec);
}